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ABSTRACT 



Between April 1985 and January 1988, Educational Testing Service 
conducted an evaluation of AL MANAAHIL (The Sources), a children's 
television series in reading for Arab children. The series, produced 
and broadcast in Jordan, contained 65 half-hour shows in Modern 
Standard Arabic (MSA) designed for children in Grades One through 
Four. The shows were intended to expose children to modern vocabulary 
and examples of accurate uses of MSA in everyday situations. 



More than 5,000 children in Jordan, Morocco, and Tunisia were 
tested in the evaluation. Based on the Jordan test data, AL MANAAHIL 
had a positive impact on children's reading skills. The positive 
findings were replicated in Government schools. United Nations 
schools, and Private schools. The findings were similar for boys and 
girls. They held up across different tests. The positive results 
were more pronounced on items more clearly related to specific goals 
of the series than on items less clearly related. The majority of 
children who participated in the testing program reported that they 
watched the AL MANAAHIL series and liked it. 



Responses of teachers, parents, and other adults to an ETS survey 
about the series were also positive. The majority of teachers (65%) 
indicated that they liked the series or liked it very much. Most 
(74%) noted that the series had a positive or very positive impact on 
the children. When asked about AL MANAAHIL' s effect on their 
teaching, a majority (54%) of teachers indicated that AL MANAAHIL had 
a positive or very positive effect. 



In several adult literacy programs, participants were asked to 
take the AL MANAAHIL tests and respond to questions about how 
frequently they viewed the series and how much they liked or disliked 
it. Of 83 adults in the literacy sample, 33 (40% of the sample) 
reported that they watched the programs on a regular basis. That 
group of 33 performed better on the AL MANAAHIL test battery than a 
group of 28 who did not watch the series at all - a result that 
supports the overall positive findings of the evaluation. 



In summary, based on the data gathered in 1986 and 1987 , AL 
MANAAHIL had a positive effect on children in this study. It is 
likely to have a similar effect on children who view the series in the 
future in Jordan and other Arab countries. 
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CHAPTER 1 



INTRODUCTION 

Children in Arab countries have an extra difficulty that most 
children do not experience when they begin school. The language used 
in reading and writing in Arabic is quite different from the 
vernacular Arabic dialects spoken at home. Dr. Muhammad Ibrahim, 
academic advisor to the AL MANAAHIL project, has described this issue 
in the following way: 

The question of literacy in Arabic has another dimension 
unknown in most languages. The fact that literacy in Arabic 
is possible only through standard Arabic, which is quite 
different from the vernacular Arabic dialects spoken at 
home, adds to the complexity of literacy acquisition by Arab 
youngsters. This linguistic problem is compounded by 
crowded classrooms, the insufficiency of children's exposure 
to standard Arabic and the critical shortage of qualified 
teachers . 

The issue of children's learning Modern Standard Arabic (MSA) was 
central to the planning and execution of the Arabic television series 
AL MANAAHIL. 



Although MSA is the language used for reading and writing, it has 
not been a language used in everyday speech. Children continue to 
speak in their local dialects when they return home from school. Arab 
nations are moving toward making greater use of Modern Standard Arabic 
in their speech as well as their writing. However, there is a concern 
that MSA is too formal for such use. In the AL MANAAHIL television 
series, Arab children see professional actors and actresses use MSA 
language accurately to communicate, to explain things, and to portray 
humor and warmth in everyday situations. They see MSA as a living, 
developing language . 



AL MANAAHIL' s overall purpose was clear in a general way, namely, 
to help children understand and use MSA. However, that was not 
sufficient for the evaluation. To evaluate the series, and the entire 
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project, Educational Testing Service (ETS) needed precise statements 
of purposes of the project. Based on the purposes of the project, and 
questions related to the purposes, ETS was able to design and 
implement an evaluation plan. 

1.1. Purposes of the AL MANAAHIL Project 

Once ETS began to examine the purposes of the project in greater 
detail, it became clear that there were a variety of purposes at 
different levels in this project. The United States Agency for 
International Development (USAID), Children's Television Workshop 
(CTW) , Arab linguists, educators, and government officials all had 
their own questions. The evaluation would have to be responsive on a 
number of fronts. 

USAID had as one of its important objectives the funding of 
projects with widespread appeal and effectiveness. This project, if 
it succeeded in creating a television series appealing to Arab 
children, might reach children in all Arab countries, not just in 
Jordan where the series was produced. If the MSA usage was acceptable 
across North Africa and the Middle East, this project would have a 
very widespread impact. One question of importance to USAID, 
therefore, was related to the extent to which the series was 
acceptable to a variety of Arab countries. 

USAID was also interested in the process by which this project 
was conducted. In conversations and in written materials, Harold 
Freeman, the USAID director of the project, asked project participants 
to identify strategics and approaches that proved to be particularly 
fruitful - for example, the initial and continuing use of advisors by 
CTW, use of local expertise in the project, making of initial 
contacts, and so forth. USAID expressed a desire to obtain 
information that would allow it to determine the feasibility of 
expanding and replicating components of an "international model" for 
implementing USAID education projects in the future. 
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Finally, USAID expressed its interest in the impact of the 

project on institutions and organizations in the host countries, and 

on special groups of viewers - frequently mentioned were women and 

illiterate adults. USAID also expressed interest in receiving 

information about legal, contractual, administrative, and professional 

activities performed during the implementation and evaluation of the 

% 

project . 

CTW's primary purpose in this project was to co-produce its first 
entirely original international series. In keeping with its objective 
of working with countries that had made substantial investments in 
broadcast television, CTW agreed to co-produce with Jordan television 
producers 65 half-hour programs entirely in Modern Standard Arabic. 



Arab educators and researchers willingly provided advice and 
assistance because they were interested in improving children s 
learning. And, the spread of Modern Standard Arabic throughout the 
Arab countries is a key goal of many Arab educators. 

To attain the broad goals implied by these purposes, the United 
States Agency for International Development (USAID) and the Government 
of Jordan funded the production of the series aimed primarily at 
children in Grades 1,2,3, and 4. The programs were to supplement the 
formal instruction that children received in school and enhance the 
knowledge and skills the children already possessed to some degree. 

Although all goals and objectives are important, and are within 
the scope of the evaluation, the language-specific goals were critical 
for the development of the reading tests needed to assess the skills 
and knowledge of the children. A complete copy of the language - 
specific goals of the project is given in Appendix A. The following 
is a summary of AL MANAAHlL's goals and objectives as they appear in a 
CTW brochure describing the Jordan project. 







AL MANAAHIL^S Goals and Objectives 

AL MANAAHIL addresses the needs of all Arab countries in 
reading curriculum, incorporating values and attitudes such 
as : 

o Arab culture and spiritual values 
o Scientific thinking 
o The dignity of manual labor 
o Appreciating women's role in society 
o Developing good health habits 
o Encouraging team work and cooperation 
o Respecting the views of others 

o Having consideration for the elderly and disabled 

AL MANAAHIL' s specific goals and language content are 
carefully balanced throughout the series. They include; 

A . PHONOLOGY - Correct pronunciation, aural discrimination, 
intonations, patterns and appreciation of the language. 

B . ORTHOGRAPHY - Letter formation and recognition; 
punctuation; the importance of dotting, diacritics , 
nunnation signs; sounds represented by different letters, 
letter shapes or symbols; sounds not represented in writing; 
silent letters and symbols. 

C . MORPHOLOGY - Associating inflections with grammatical 
devices; special reading issues, such as hamzatu- 1-waSl in 
some verb forms, sound and broken plurals, dual forms, 
passive and active verb forms; derivational patterning; 
structural patterning and analysis; vowel mutations. 

D . SYNTAX - Word order, grammar, and their importance to 
meaning; question/answer patterns; sentence structure. 

E . LEX I S - Expanding MSA vocabulary; basic sight reading 
vocabulary, including function words, expressions, high- 
frequency words in a child's environment, idioms, word 
families, root words, synonyms and antonyms; use of 
reference material. 

F. COMPREHENSION - Basic skills required to supply a missing 
word or letter; sequence scrambled words or sentences; 
interpret text by paraphrasing; articulate main idea of 
text; judge the plausibility of a sentence. 

The series was produced in late 1986 and early 1987. It began showing 
in Jordan in May 1987. 
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1.2. Purposes of the ETS Evaluation 

The general purpose of the evaluation was to provide information 
for decision-makers in a variety of audiences including USAID, the 
funding agency; the developers and producers of the series in the 
United States and Jordan; educators interested in the potential of 
television and the mass media as an aid to learning; Arab educators 
interested in Modern Standard Arabic; and members of the educational 
research community. Some information will be more relevant to 
specific groups. Simple descriptive information will be sufficient 
for some groups; others will be interested in the technical aspects of 
the information. We have included both types of information in the 
body of the report and the appendices. 

It was not clear that ETS would be able to conduct the 
evaluation in the same way that it conducted independent evaluations 
in the United States. Therefore, one initial purpose of the 
evaluation study was to undertake a study of the feasibility of 
conducting the evaluation in a number of Arab countries in the Middle 
East and North Africa before proceeding. That study was conducted, 
and the evaluation was judged to be feasible. 

The following questions, based on the purposes of the AL MANAAHIL 
project, were used to guide the design of the evaluation: 

1. To what extent was the television series produced and 

implemented as planned? 

2. What was its effect on the children's knowledge of and 

skill in using Modern Standard Arabic? 

3. To what extent was the series viewed by children? 

4. Was the series attractive to students? 

5. What was its impact on teachers and parents? 



6 - 



In addition to providing answers to these explicit questions, the 
evaluation was to be attentive to any side effects that might be 
caused by the series and any negative effects perceived by Arab 
educators and/or adults. 

The evaluation did not include experimental conditions with 
planned variation in viewing intensity of the programs. Because the 
series was to be shown on national television, and because the 
advisory board indicated that the vast majority of children would view 
the series, the . treatment was the exposure of all children in Jordan 
to the series. This view of the treatment is explained more fully in 
later sections of the report dealing with the evaluation design. 
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CHAPTER 2 

PREPARATION AND DATA COLLECTION 

Before proceeding with the evaluation, ETS was required to 
conduct a feasibility study to determine if the evaluation could be 
carried out effectively in Jordan. If the evaluation project was 
considered feasible, then ETS was to conduct the evaluation between 
November 1985 and December 1987. 

2.1. Feasibility of the Evaluation 

A feasibility study was conducted in July and August of 1985. As 
ETS project director, I visited Jordan, participated in the second CTW 
workshop in Amman, and explored the feasibility questions with members 
of the advisv^ry committee. In addition, with assistance from staff of 
AMIDEAST, I visited the Ministry of Education, the University of 
Jordan, Yarmouk University, and several primary schools in Amman. The 
Arab educators I met with were very encouraging. Basically, the 
discussions were concerned with the following three questions: 

(1) Could an adequate design be implemented to guarantee 
information capable of providing answers to the 
questions in the evaluation? 

(2) Would ETS be able to insure valid and reliable tests 
to measure the children's language and reading skills? 

(3) Would ETS be able to collect valid and reliable data 
for an evaluation in Jordan and other Arab countries? 

These three questions correspond to the three critical elements in any 
evaluation: (1) evaluation design, (2) instrument development, and 
(3) data collection. 

Evaluation design . The research design issue was an important 
one. In conducting evaluations, ETS had ordinarily implemented a type 
of experimental or quasi -experimental design in which some children 
participated in the program being evaluated and some did not. It was 
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not clear that such a design could be implemented in this study. 
However, in discussions with members of the advisory committee, other 
Arab educators, and CTW researchers, we decided that this issue was 
not really relevant to working in a foreign country without previous 
experience. The difficulties involved in designing the research so 
that valid conclusions could be drawn turned out to be more related to 
the fact that television is universal in Jordan. Even in refugee 
settlement areas, television was universal. Therefore, how could the 
impact of AL MANAAHIL on the reading skills of children be assessed in 
the absence of a control group of children who did not view the series 
at the same time that the treatment children did view the series? 
Acting on the advice of the advisory committee, ETS suggested to CTW 
and USAID a design in which observed reading skills of children in a 
sample of schools in 1987 would be compared with the observed reading 
skills of similar children in the same schools in 1986. 

On the whole, the issue of research design was not a prohibitive 
one. On October 31, 1985, USAID accepted the ETS suggestions and 
agreed to fund the evaluation. ETS agreed to arrange for testing four 
distinct samples of children in two separate samples of schools. 

In one sample of schools, children were to be tested in May 1986 and 
May 1987. In the other sample of schools, children were to be tested 
in December 1986 and December 1987. It was anticipated that the 1986 
test administrations would take place before the series went on the 
air; the 1987 test administrations would take place after the series 
was on the air. The projected date for beginning broadcasting was 
January 1987. 

Instrument development . In the United States, ETS had available 
many tests of reading skills used in its own projects and those of 
others, including the evaluations of Sesame Street and The Electric 
Company . Were such tests available in Jordan and other Arab 
countries? If not, could they be designed and developed at ETS? 

Could they be designed and developed by Arab educators in the 
participating countries? Would there be educators familiar with test 
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design and construction, with item writing skills? Would ETS be able 
to collaborate effectively with Arab educators? 

As it turned out, instrument development in Jordan appeared to be 
feasible. More than twenty Jordanian educators had participated in 
ETS summer training programs in item writing, test analysis, and 
program evaluation since 1970. The goals and objectives for the 
project had been favorably reviewed by the advisory committee and were 
available as a basis for item writing. Members of the advisory 
committee reviewed a large number of sample test items in English 
provided by ETS from previous work conducted in the United States. 

They encouraged ETS to arrange for similar items to be constructed in 
Arabic. The view of ETS was that this approach would be feasible. 

USAID accepted that view. 

Data Collection . In studies in the United States, permission to 
gather information in schools is obtained at the state or district 
level. After clearance is obtained, ETS ordinarily works in a 
collaborative way with local schools and teachers. It was not clear 
that such a strategy could be implemented in the Middle East and North 
Africa. 

Data collection was not perceived as a problem by Arab educators . 
Although we did not decide who would collect the data, nor how it 
would be collected, every Arab educator interviewed, including the 
Minister of Education, curriculum experts at the Ministry, principals 
and teachers at several schools, and administrators at UNRWA 
headquarters, agreed that schools would gladly cooperate in the 
research. That proved to be the case. 

The feasibility plan was prepared and presented to CTW and USAID. 
It was discussed at a meeting in Washington on October 31, 1985. 

’^SAID staff made suggestions about the test instrument to be used, 
about strategies for test administration, asked that other countries 
be involved if at all possible, and directed both CTW and ETS to place 
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heavier stress on reading comprehension skills in the project and the 
evaluation. Then, clearance was given to proceed with the evaluation. 

Having received USAID acceptance of the ETS plan for the 
evaluation, I returned to Amman in December 1985 to identify Arab 
educators to coordinate the activities required to develop the items 
and tests needed, select the samples, arrange for test administration, 
collect data, and transmit data to ETS in the United States. At every 
meeting with educators - those who had participated in the ETS summer 
programs in Item Response Theory, Test Development, and Program 
Evaluation; those at the Ministry of Education; and, those at the 
Universities - an interest in the evaluation was expressed. However, 
all educators interviewed suggested that the test development and data 
collection efforts should be directed and coordinated by Dr. Abdallah 
Kaylani, Dean of the Faculty of Education, University of Jordan. 

As a result, I met with Dr. Kaylani and asked him to consider 
taking responsibility for the instrument development and data 
collection components of the evaluation. He had taken Fred Lord's 
course on Item Response Theory at ETS and was interested in 
collaborating in this project. However, his time was limited. He 
agreed to discuss the matter with his colleagues. I left Jordan on 
December 15, 1985 without having negotiated any contracts and with 
nothing definite in place. 

On January 15, 1986, I received a letter from Dr. Muhammad 
Ibrahim saying that he had met several times with Dr. Kaylani, Dr. 

Sami Khasawnih, and Dr. Fakhri Tomalia. Dr. Kaylani agreed to take 
responsibility for test development and production, as well as for 
coordination of the data collection and training of test 
administrators. He asked me to return as soon as possible to 
negotiate the necessary contracts. 
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2.2. Evaluation Desig n 

In February 1986, I returned to Amman to negotiate a contract 
with Dr. Abdallah Kaylani to design reading tests and coordinate the 
data collection in Jordan. I presented in detail what was needed by 
ETS in order to conduct a valid evaluation. 

I had learned during the feasibility study that there were three 
types of schools in Jordan: Government schools, those administered by 
the Jordanian government; UNRWA (United Nations Refugee and Warfare 
Agency) schools for Palestinian children administered by United 
Nations personnel; and, private schools, those administered by 
private, primarily religious, organizations. In the 1983-84 school 
year, there were 1,148 primary schools in Jordan - 82% government 
schools, 9% UNRWA schools, and 9% private schools. Of the total, 47% 
were coed, 28% enrolled boys only, and 25% enrolled girls only. 
Although government and UNRWA schools included large numbers of each 
type of school, private schools were primarily (96%) coeducational. 

The majority of schools (78%) and children (84%) were in two areas of 
the country, Amman and Irbid. 

In discussing a design for the May 1986 testing. Dr. Kaylani and 
I agreed to include schools outside the areas of Amman and Irbid. 
However, data collection proved to be difficult due to transportation, 
lodging, and schedules of the test administrators. In the December 
1986 test administration, the sample size was reduced and focused in 
the regions of Amman and Irbid. As the production of the AL MANAAHIL 
series progressed, the beginning date for broadcast was rescheduled 
for May 1987. As a result, we did not test the children in May 1987. 
All results are based on the December 1986 and December 1987 test 
administrations. The design for the December 1986 test administration 
is given in Table 2.2.1. 

Assuming an average of two classes per grade, this design was 
intended to result in 10, 20, 10, and 10 classes in Grades 1, 2, 3, 
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Table 2.2.1 
Evaluation Design 



j Type of School 


1 

1 Students 


1 

1 

, 1 


1 


Grades 
2 3 


A 




1 A. Governnent 


1 


1 

1 












1 1. Annan 


1 

1 Boys only 
1 


1 

1 

1 


X 


X 




X 






1 

1 Girls only 
1 


1 

1 

1 


X 


X 


X 








1 

1 Coed 


1 

1 

1 




X 


X 


X 




1 2. Irbid 


1 

1 Boys only 
1 


1 

1 

1 




X 


X 








1 

1 Girls only 
1 


1 

1 

1 




X 




X 






1 

1 Coed 
1 


1 

1 

1 


X 


X 








1 B. UNRWA 


1 

1 Boys only 
1 


1 

1 

1 


X 


X 










1 

1 Girls only 
1 


1 

1 

1 




X 


X 








1 

1 Coed 
1 


1 

1 

1 




X 




X 




1 C. Private 


1 

1 Coed 


1 

1 


X 


X 


X 


X 
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and A respectively. Assuming an average class size of 20 to 25 
children, we expected to test approximately AOO to 500 children in 
second grade and about half as many in each of the other three grades . 
If a grade was included in a school, all children in that grade were 
to be tested. 



2.3. Instrument Development 

The statement of goals and objectives went through more than five 
drafts from its inception at a meeting in New York City in June 1985 
through its final ratification by the multinational advisory committee 
in Amman in May 1986. The primary architect was Dr. Muhammad Ibrahim, 
Director of the Center for Linguistics, University of Jordan. Based 
on the complex discussions of participants in the early meetings in 
New York, he fashioned the original draft. Then, as the project 
progressed and more input was received, he re-drafted the statement. 
The final draft. Draft 5a, was used as the basis for the production of 
the programs and of the reading tests used in the evaluation. 



During the course of developing the goals, emphasis shifted 
toward higher order reading skills including comprehension. Kay 
components in the Arab language, such as the centrality of roots in 
word development and meaning, received greater stress; less critical 
components, such as phonetics and decoding, re'.eived less stress. The 
final document ratified by the advisory committee is a relatively long 
document with rationales for including certain components, background 
notes, goals related to Arabic culture and tradition, strategies for 
the production team relevant to specific goals and objectives, and 
examples to illustrate specific goals and objectives. A complete copy 
of the language -specific goals of the project is given in Appendix A. 
ETS used the goals and objectives statement to develop a corresponding 



of objectives for a reading test in Modern Standard Arabic. 
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During the feasibility study, ETS was not able to locate any 
appropriate tests of Arabic reading skills. In addition, expertise 
for developing such tests did not exist within ETS. Therefore, the 
decision was made early in the project that the tests would be totally 
designed and developed in the Arab countries involved in the project. 

Dr. Kaylani agreed to design two tests, each approximately 100 
items long, with 25 common items in both tests, and to chair a test 
development committee to write the required 175 items following 
specifications and guidelines provided by ETS. Once the tests were 
developed, they were to be printed in Jordan - approximately 4,000 
copies. Dr. Kaylani also agreed to write administration manuals for 
administering the tests and train the test administrators. He agreed 
to coordinate the ^ lection of schools, the data collection, and the 
recording and transferring of student data to ETS in the United 
States. 

We estimated costs for the effort, and ETS agreed to wire funds 
to Dr. Kaylani on March 1, April 1, and May 1 to cover expenses. 

During the project, two additional contracts were negotiated - one in 
October 1986 for the December 1986 testing, and one in October 1987 
for the December 1987 testing. 

Dr. Kaylani had agreed to chair the test development committee 
provided Dr. Muhammad Ibrahim, Chief Academic Advisor, agreed to work 
on the committee with him. Dr. Ibrahim agreed to do so and suggested 
that Dr. Fakhri Tomalia, Dean of Students, Amman Technical Institute, 
and a member of the CTW advisory committee join the committee. 
Subsequently, Dr. Sami Khasawnih, Chairman, Department of Educational 
Administration at the University of Jordan, and Mustafa Kaylani, an 
experienced primary school reading teacher, joined the committee. Dr. 
Abdallah Kaylani and Dr. Sami Khasawnih had attended the ETS summer 
programs in test theory and were familiar with ETS guidelines for item 
writing. The ETS project director provided copies of reading test 
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Items in English used in a number of previous ETS evaluation projects 
to illustrate a range of item types and foirmats. 

The committee began work in February and worked intensively 
through April 1986. Copies of completed items were forwarded to ETS 
for review. Weekly phone calls confirmed that the tests were likely 
to be ready in time for testing in early May 1986. The committee 

wrote more than 200 items covering the goals and objectives in the CTW 

statement given in Appendix A. Dr. Kaylani provided, in English, the 
excellent descriptions of test items given in Appendix B. 

The items were distributed into two tests with 25 common items: 

(1) Level A appropriate for Grades 1 and 2; and, 

(2) Level B appropriate for Grades 3 and 4. 

In April 1986, I returned to Amman and reviewed all items with Dr. 
Kaylani. The tests were printed in Jordan and, in May 1986, 
administered to a sample of approximately 3,000 children in Grades 1 
through 4 in 22 schools throughout Jordan. In early May 1986, I 
observed two test administrations, one in Grade 1 and one in Grade 2. 
Dr. Kieth Mielke, CTW Vice President for Research, observed the Grade 
1 test administration with me. The test administrations proceeded as 
planned . 

Detailed item analyses and test analyses were conducted on the 
May 1986 data. In general, the analyses indicated that the tests were 
valid for the evaluation and reliable in the samples of children 
tested. However, there were a number of items (approximately 25) that 
needed revision based on the item analyses. In addition, many items 
in the Level A test were very difficult for Grade 1 and 2 children. 

On the other hand, some items in the Level B test were easy for Grade 
3 and 4 children and appeared to be more suitable for the Level A 
test. Dr. Abdallah Kaylani and the ETS project director decided to 
revise the tests and create a battery of eight subtests for the 
December 1986 testing. A description of the final AL MANAAHIL test 
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battery is given in Table 2.3.1. Note that all children were to take 
Subtests 3 and 4 - the Core Test administered across all grades in the 
evaluation, 

2.4. Data Collection 

In May 1986, the basic design was implemented as planned. More 
than 1,300 children in 49 second grade classes in 22 schools were 
tested. In Grades 1, 3, and 4, more than 1,500 children were tested 
in 18, 16, and 21 classes respectively. The data collection proved to 
be difficult and costly due to transportation, lodging, and scheduling 
for test administrators - especially in areas outside of Amman and 
Irbid. In the December 1986 test administration, the sample size was 
reduced and resources were focused in the regions of Amman and Irbid. 

As explained in Section 2.3, Instrument Development . the May 1986 
test data were used to validate and revise the tests for the December 
1986 test administration. After the tests were revised, samples of 
approximately 1,200 children in 13 schools were tested in December 
1986 and December 1987. Because the series began broadcasting in 
May 1987, children were not tested at that point, and the May 1986 
data were not used as a baseline point in the evaluation. 

Summaries of the numbers of children tested in December 1986 and 
December 1987 are given in Tables 2.4.1 and 2.4.2. The design was 
basically implemented as planned. Note that in some schools, children 
were tested in both 1986 and 1987. For example. School 1 included 
children in Grades 1 and 2 in both years. The children in Grade 1 in 
1986 moved into (by and large) Grade 2 in 1987. We examined these 
data for possible analysis across years for the same students using a 
measure of viewing based on the children's responses to a question 
about their viewing in 1987. This exploration proved fruitless. 
Although a sizeable number (approximately 200) of the children were 
matched across the two years, the number of children in any one grade 
who did not view the series was very small. 
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Table 2.3.1 

Description of the AL MAMAAHIL Arabic Reading Test 



SUBTEST 


1 ITEMS 

1 


1 1 


GRADE 1 


1 GRADE 2 


1 GRADE 3 


GRADE 4 


1 


■I 

1 

1 1 - 


20 


1 1 
1 20 1 
1 1 


X 








2 


1 

1 21 - 


40 


1 1 

1 20 1 
I 1 


X 


1 ^ 






3 


1 

1 41 - 


65 


1 1 

1 25 1 
1 1 


X 


i ^ 


1 X 


X 


4 


1 

1 66 - 
1 


80 


1 1 

1 15 1 
1 1 


X 


1 ^ 


1 X 


X 


5 


1 81 - 


100 


1 1 

1 20 1 
I 1 




1 X 


1 X 


X 


6 


1 

1 101 - 


120 


1 1 
1 20 1 
1 1 




1 X 


t X 


X 


7 


1 

1 121 - 


140 


1 1 
1 20 1 
1 1 






1 X 


X 


8 


1 

1 141 - 
1 


160 


1 1 
1 20 1 
1 1 








X 


TOTAL NUMBER OF 


ITEMS 


|160 i 


80 


i 100 


1 100 


120 
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Table 2.4.1 

Number of Children by School, Grade, and Class 
Jordan - Deceii>er 1986 



1 

chool 1 Region 


Type 


j Students | 


Grade 


1 1 


Class 

2 


3 


1 


1 

1 Aoman 


1 Govt. 


1 Male 1 


1 


1 22 


17 


_ ^ 




1 






2 


1 24 


29 






1 






4 


1 26 


20 


-- 


2 


1 

1 Anman 


1 Govt. 


1 Female | 


2 


I 24 


24 


_ _ 




1 






3 


1 25 


22 




3 


1 

1 Amman 


1 Govt. 


1 Female | 


1 


1 19 


20 




4 


1 

1 Amman 


1 Govt. 


1 Coed 1 


2 


1 19 


44 


33 




1 






3 


1 33 


22 






1 






4 


1 ^2 


35 




5 


1 

1 Irbid 


1 Govt. 


1 Male 1 


2 


1 28 


26 


_ _ 




1 






3 


1 24 


24 


-- 


6 


1 

1 Irbid 


1 Govt . 


1 Female | 


2 


1 27 


27 







1 






4 


1 22 


-- 


-- 


7 


1 

1 Irbid 


1 Govt . 


1 Female | 


4 


1 3^ 


-- 


-- 


8 


1 

1 Irbid 


1 Govt. 


1 Coed 1 


1 


1 1^ 


13 


_ ^ 




1 






2 


1 1^ 


15 


-- 


9 


1 

1 Amman 


1 UNRWA 


1 Female | 


2 


1 ^1 


43 


_ _ 




1 






3 


1 30 


30 




10 


1 

1 Amman 


1 UNRWA 


1 Male 1 


1 


1 51 


46 


_ _ 




1 






2 


1 46 


46 




11 


1 

1 Amman 


1 UNRWA 


1 Coed 1 


2 


1 28 


32 


_ _ 




1 






4 


1 50 


49 




12 


1 

1 Amman 


1 Private 


1 Coed 1 


1 


1 19 


21 


_ _ 




1 






2 


1 18 


23 






1 






3 


1 18 


20 


-- 


13 


1 

1 Amman 


1 Private 


1 Coed 1 


4 


1 22 


23 





O 
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Table 2.4.2 

Nuid>er of Children by School, Grade, and Class 
Jordan - Deceiiber 1987 



School 


j Region 


1 

1 Type 


Students 


Grade 


1 

1 


1 


Class 

2 


3 




1 


1 Annan 


1 

1 Govt. 


Coed 


1 


1 

1 


15 


16 










1 




2 


1 


26 


25 










1 




4 


1 


20 


20 






2 


1 Amman 


1 

1 Govt. 


Coed 


2 


1 

1 


29 


26 










1 




3 


1 

1 


28 


28 






3 


1 Anman 


1 

1 Govt. 


Female 


2 


1 

1 

1 


24 


-- 


-- 




4 


1 Amman 


1 

1 Govt. 


Coed 


1 


1 

1 


24 




-- 








1 




2 


1 


25 


25 


-- 








1 




3 


1 


23 


19 


-- 








1 




4 


1 


27 








5 


1 Irbid 


1 

1 Govt. 


Male 


2 


1 

1 


28 


26 










1 




3 


1 


22 


24 






6 


1 Irbid 


1 

1 Govt. 


Female 


2 


1 

1 


17 


18 










1 




4 


1 

1 


21 


21 






7 


1 Irbid 


1 

1 Govt. 


Female 


4 


1 

1 

1 


30 


-- 


-- 




8 


1 Irbid 


1 

1 Govt . 


Coed 


1 


1 

1 


16 


16 










1 




2 


1 

1 


15 


14 






9 


1 Annan 


1 

1 UNRWA 


Female 


2 


1 

1 


34 


35 










1 




3 


1 


35 


34 


- - 




10 


1 Annan 


1 

1 UNRWA 


Male 


1 


1 

1 


35 


36 










1 

1 




2 


1 


34 


38 






11 


1 Annan 


1 

1 UNRWA 


Coed 


2 


1 

1 


35 


32 


-- 








1 




4 


1 


35 


37 






12 


1 Annan 


1 

1 Private 


Coed 


1 


1 

1 


23 


18 










1 




2 


1 


28 


31 


-- 








1 




3 


1 


19 




-- 








1 




4 


1 


25 


■ 






13 


1 Annan 


1 

1 Private 


Coed 


2 


1 

1 


36 


- - 


-- 








1 

1 




4 


1 

1 


26 


26 
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In 1986, we anticipated that several other Arab countries might 
broadcast the television series during 1987. Two of the members of 
the CTW advisory committee, Dr. Abde Header Ezzaki, Associate Professor 
of Education, University of Mohammed V, Rabat, Morocco, and Dr. 
Mohammed Maamouri, Director of the Bourgiba Institute of Languages, 
Tunis, Tunisia agreed to coordinate the testing of small samples of 
children in their countries. That testing was carried out in January 
1987 (See Tables 2.4.3 and 2.4.4). Although it is likely that Morocco 
and Tunisia will eventually broadcast the series, they did not do so 
in 1987. As a result, no further testing was conducted in those 
countries . 

In Jordan, approximately 100 adults in local literacy programs in 
Amman were tested in December 1986 (Table 2.4.5). We had hoped to 
locate some of the same adults, or groups of similar adults, in 1987. 
We also anticipated that we might be able to implement a small study 
using videotapes of the television series with the same adults over 
time. Although we did test an additional group of adults in 1987 
(Table 2.4.6), our expectations were not realized and we did not 
compare the two groups. 

Data collection was directed by Dr. Anmar Kaylani. Test 
administrators included 7 faculty members and 8 graduate students in 
the University of Jordan. Dr. Abdallah Kaylani conducted the 
training. 

In May 1986, the test administrators worked in pairs, one member 
of the team reading the instructions to the children while the other 
circulated around the room making sure that the children were 
following the instructions. This strategy worked very well in May 
1986 and was repeated in December 1986 and December 1987. 

After the test administrators completed the test administration, 
they recorded the student responses on special computer layout sheets 
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Table 2.4.3 

Nuid>er of Children by School. Grade, and Class 
Morocco - January 1987 



School 


I 

,| Region 


Type 


i 1 

1 Students | 
1 1 


Grade 


1 


Class 

2 


3 


1 


1 Rabat 


Govt. 


1 Male 1 


1 


29 


28 


-- 




1 




1 i 


2 


27 


31 


33 




1 

1 




1 i 


3 


37 


35 


-- 




1 

I 




1 1 


4 


26 


27 


21 


2 


I 

1 Rabat 


Govt. 


1 1 
1 Coed 1 


1 


26 


31 


25 




1 




i 1 


2 


34 


22 


32 




I 




1 1 


3 


31 
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Table 2.4.4 

Nusdier of Children by School, Grade, and Class 
Tunisia - January 1987 



School 


I 

-I Region 


I 

Type 1 

■ 


I 

Students | 

1 - 


Grade 


1 


2 


Class 

3 


4 


5 


1 


1 Ttmls 


r 

Govt. 1 


Coed 1 


1 


32 












1 


1 


I 


2 


29 


30 


29 


33 


30 




1 

1 


1 


I 


3 


32 


31 










1 

1 


I 

i 


I 


4 


38 


35 








2 


1 

1 Tvinis 


I 

Private | 


1 

Coed 1 


1 


37 












1 


I 


I 


2 


39 


36 


38 
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Table 2.4.5 

Number of Adults in Literacy Programs by School and Grade 
Jordan ** l^cember 1986 



School 


1 1 
1 Students | 


Grade 


1 No. of 
1 Adults 


1 


1 1 
1 Female | 


1 


1 12 




1 1 

1 t 


3 


I 24 


2 


1 1 

1 Male 1 

1 I 


1 


1 12 


3 


1 1 

1 Male 1 

1 1 


2 


1 25 


4 


1 1 

1 Female | 

I t 


2 


1 16 


5 


1 1 

1 Female | 

1 t 


4 


1 8 


6 


1 1 
1 Male 1 


3 


1 5 




1 ! 


4 


1 5 



Table 2.4.6 

Number of Adults in Literacy Programs by School and Grade 
Jordan - December 1987 



School 


1 1 

1 Students | 
• • 


Grade 


No. of 
Adults 


1 


1 1 

1 1 

1 Male 1 

1 t 


1 


7 


2 


1 I 

1 Male 1 

1 1 


3 


11 


3 


1 1 

1 Female | 

I 1 


3 


18 


4 


1 1 

1 Female | 
1 1 


3 


12 


5 


1 1 
1 Male 1 


1 


7 




1 1 

1 t 


3 


4 


6 


1 1 
1 Female | 


1 


8 




1 1 

1 t 


3 


13 


7 


1 1 
1 Female | 


4 


6 
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for transmittal to ETS for keypunching. The data were very complete. 
Because children were paced through the tests, most completed all 
questions. In addition, the test administrators provided dates of 
birth for almost all children. 

Summary test statistics are given in Tables 2.4.7 and 2.4.8 for 
the December 1986 and December 1987 test administrations in Jordan. 
Similar data are given for the Morocco (Table 2.4.9) and Tunisia 
(Table 2.4.10) data to support the conclusion that the test is 
appropriate for North Africa as well as the Middle East as intended. 

In the first section of Table 2.4.7, for each Grade Level Test, 
we list the reliability coefficient (REL. ) , the standard error of 
measurement (S.E.M.), the number of pupils tested, the number of items 
in the test, the mean score, and the standard deviation (S.D.) of the 
scores. For example, in Grade 2, the reliability of the test was .94; 
the standard error of measurement was 4.2; 610 children were tested; 
the test contained 100 items; the mean score was 47.8 items correct; 
and, the standard deviation of the scores was 17.6. These results are 
reasonable for this kind of test. 

On the Core Test, in December 1986, the reliabilities are smaller 
than those on the Grade Level Tests. However, given that the number 
of items is less than on the Grade Level Tests (40 items) , the results 
are good. The subtests have fewer items (15, 20, or 25), but the 
sample sizes are larger for the most part. The results for Jordan in 
December 1987, and for Morocco and Tunisia in January 1987, are 
similar. In general, the results indicate that the tests are reliable 
and are valid for the purposes of the evaluation. Tables giving other 
types of technical data (subtest correlations, r-biserials, and delta 
coefficients) are given in Appendix C. 
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Table 2.4.7 

Summary Test Statistics 
Jordan - Deceaber 1986 







1 


1 




1 NO. 


1 NO. 




1 








TEST 


1 REL. 


1 

1 


S.E.M. 


1 PUPILS 


1 ITEMS 


1 MEAN 


1 


S.D. 






GRADE 1 TEST 


1 

1 

1 0.90 


1 

1 

1 


3.8 


1 

1 

1 240 


1 80 


1 25.1 


1 

1 

1 


11.8 






GRADE 2 TEST 


1 0.94 


1 


4.2 


1 610 


1 100 


1 47.8 


1 


17.6 






GRADE 3 TEST 


1 0.94 


1 


4.1 


1 245 


1 100 


1 60.9 


1 


16.6 






GRADE 4 TEST 


1 0.95 
1 


1 

1 


4.5 


1 320 

1 


1 120 


1 74.2 


1 

1 


19.9 






CORE TEST (Gl) 


1 

1 0.82 


1 

1 


2.6 


1 

1 240 


1 40 


1 11.9 


1 

1 


6.1 






CORE TIZST (G2) 


1 0.87 


1 


2.6 


1 610 


1 40 


1 21.6 


1 


7.3 






CORE TEST (G3) 


1 0.85 


1 


2.4 


1 245 


1 40 


1 28.3 


1 


6.0 






CORE TEST (G4) 


1 0.86 
1 


1 

1 


2.4 


1 320 

1 


1 40 


1 29.1 


1 

1. 


6.3 






SUBTEST 1 


1 

1 0.72 


1 

1 


1.9 


1 

1 240 


1 20 


1 6.8 


1 

1 


3.6 






SUBTEST 2 


1 0.84 


1 


1.9 


1 850 


i 20 


1 10.2 


1 


4.7 






SUBTEST 3 


1 0.87 


1 


2.0 


1 1420 


1 25 


1 14.9 


1 


5.6 






SUBTEST 4 


1 0.82 


1 


1.6 


1 1420 


1 15 


! 7.9 


1 


3.8 






SUBTEST 5 


1 0.82 


1 


1.9 


1 1175 


1 20 


1 9.7 


1 


4.5 






SUBTEST 6 


1 0.89 


1 


1.8 


1 1170 


1 20 


1 9.5 


1 


5.6 






SUBTEST 7 


1 0.73 


1 


2.0 


1 565 


1 20 


1 10.5 


1 


3.8 






SUBTEST 8 


1 0.70 


1 


2.0 


1 320 


1 20 


1 8.7 


1 


3.7 
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Table 2.4.8 

Suonary Test Statistics 
Jordan - Deceid>er 1987 









1 




1 NO. 


NO. 




1 








TEST 


1 REL. 


1 

1 


S.E.M. 


1 PUPILS 


ITEMS 


MEAN 


1 


S.D. 






GRADE 1 TEST 


1 0.86 


"1" 

1 

1 


4.0 


1 

1 

1 195 


80 


31.1 


1 

1 

1 


10.6 






GRADE 2 TEST 


1 0.91 


1 


4.3 


1 570 


100 


54.5 


1 


14.9 






GRADE 3 TEST 


1 0.94 


1 


4.1 


1 230 


100 


66.9 


1 


16.6 






GRADE 4 TEST 


1 0.95 


1 

1 


4.3 


1 285 

1 


120 


83.5 


1 

1 


19.8 






CORE TEST (Gl) 


1 0.76 


1 

1 


2.7 


1 

1 195 


40 


15.0 


1 

1 


5.6 






CORE TEST (G2) 


1 0.85 


1 


2.6 


1 570 


40 


24.0 


1 


6.8 






CORE TEST (G3) 


1 0.87 


1 


2.4 


1 230 


40 


29.2 


1 


6.6 






CORE TEST (G4) 


1 0.88 


1 


2.1 


1 285 


40 


32.6 


1 


6.2 






SUBTEST 1 


1 0.70 


1 

1 


1.9 


1 

1 195 


20 


8.3 


1 

1 


3.6 






SUBTEST 2 


1 0.79 


1 


1.9 


1 765 


20 


11.9 


1 


4.2 






SUBTEST 3 


1 0.88 


1 


1.9 


1 1285 


25 


16.4 


1 


5.5 






SUBTEST 4 


1 0.79 


1 


1.6 


1 1285 


15 


9.0 


1 


3.5 






SUBTEST 5 


1 0.80 


1 


2.0 


1 1090 


20 


11.1 


1 


4.4 






SUBTEST 6 


1 0.88 


1 


1.9 


1 1090 


20 


11.1 


1 


5.3 






SUBTEST 7 


1 0.77 


1 


1.9 


1 520 


20 


12.2 


1 


4.0 






SUBTEST 8 


1 0.73 


1 


2.0 


1 285 


20 


9.5 


1 


3.9 
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Table 2.4.9 

Summary Test Statistics 
Morocco - January 1987 







1 




1 




1 NO. 


i NO. 


1 




1 








TEST 


1 

- 1 


REL. 


1 


S.E.M. 


1 PUPILS 


1 ITEMS 


1 

1 


MEAN 


1 

1 


S.D. 






GRADE 1 TEST 


•|“ 

1 

1 


0.93 


I" 

1 

1 


3.8 


1 135 


1 80 


■|" 

1 

1 


39.3 


1 

1 


14.4 






GRADE 2 TEST 


1 


0.93 


1 


4.0 


1 175 


1 100 


1 


64.5 


1 


15.0 






GRADE 3 TEST 


1 


0.90 


1 


3.9 


1 105 


1 100 


1 


68.2 


1 


12.5 






GRADE 4 TEST 


1 

1 


0.86 


1 

1 


4.4 


1 70 


1 120 


1 

1 


75.7 


1 

1 


11.7 






CORE TEST (Gl) 


1 

1 


0.86 


1 

1 


2.6 


1 135 


1 40 


1 

1 


17.6 


1 

1 


7.1 






CORE TEST (G2) 


1 


0.82 


1 


2.4 


1 175 


1 40 


1 


26.2 


1 


5.8 






CORE TEST (G3) 


1 


0.78 


1 


2.4 


1 105 


1 40 




28.5 


1 


5.2 






CORE TEST (G4) 


1 

1 


0.57 


1 

1 


2.3 


1 70 


1 40 


1 

1 


30.0 


1 

1 


3.6 






SUBTEST 1 


1 

1 


0.79 


1 

1 


1.9 


1 135 


1 20 


1 

1 


10.7 


1 

1 


4.1 






SUBTEST 2 


1 


0.85 


1 


1.8 


1 310 


1 20 


1 


13.4 


1 


4.5 






SUBTEST 3 


1 


0.85 


1 


1.9 


1 490 


1 25 


1 


16.9 


1 


4.9 






SUBTEST 4 


1 


0.74 


1 


1.6 


1 490 


1 15 


1 


8.0 


1 


3.2 






SUBTEST 5 


1 


0.69 


1 


1.9 


1 355 


1 20 


1 


12.2 


1 


3.4 






SUBTEST 6 


1 


0.81 


1 


1.8 


1 355 


1 20 


1 


13.1 


1 


4.2 






SUBTEST 7 


1 


0.58 


1 


1.9 


1 175 


1 20 


1 


11.3 


1 


3.0 






SUBTEST 8 


1 


0.50 


1 


1.9 


1 70 


1 20 


1 


7.9 


1 


2.7 






37 
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Table 2.4.10 
Sunnary Test Statistics 
Tunisia. - January 1987 





1 






NO. 


NO. 


I 




1 




1 TEST 


1 

1 


UEL. 


S.E.M. 


PUPILS 


ITEMS 


I 


MEAN 


1 S.D. 

-1 — 




1 GRADE 1 TEST 


■r 

1 

1 


0.94 


3.6 


65 


80 


1 

1 

1 


33.6 


1 

1 

1 14.5 




1 GRADE 2 TEST 


1 


0.93 


4.2 


260 


100 


1 


51.4 


1 16.1 




1 GRADE 3 TEST 


1 


0.92 


4.1 


60 


100 


1 


54.9 


1 14.4 




1 GRADE 4 TEST 


1 

1 


0.89 


4.0 


70 


120 


1 

1 


82.0 


1 12.1 

. 1 . 




1 CORE TEST (Gl) 


1 

1 


0.89 


2.3 


65 


40 


1 

1 


13.0 


1 

1 7.2 




1 CORE TEST (G2) 


1 


0.88 


2.5 


260 


40 


1 


22.3 


1 7.2 




1 CORE TEST (G3) 


I 


0.83 


2.4 


60 


40 


1 


25.3 


1 5-8 




1 CORE TEST (G4) 


1 

1 


0.64 


1.8 


70 


40 


1 

1 


32.4 


I 3.1 

I 




1 SUBTEST 1 


1 

1 


0.79 


1.9 


65 


20 


1 

1 


10.7 


1 

1 4.0 




1 SUBTEST 2 


1 


0.77 


1.9 


330 


20 


1 


11.5 


1 4.0 




1 SUBTEST 3 


1 


0.88 


1.9 


465 


25 


1 


16.2 


1 5.4 




1 SUBTEST 4 


1 


0.75 


1.5 


430 


15 


1 


7.3 


1 3.1 




1 SUBTEST 5 


I 


0.76 


2.0 


395 


20 


1 


9.8 


1 4.0 




1 SUBTEST 6 


1 


0.84 


1.9 


395 


20 


1 


10.3 


1 




1 SUBTEST 7 


1 


0.68 


1.9 


135 


20 


1 


10.3 


I 3.5 




1 SUBTEST 8 


1 


0.62 


1.9 


70 


20 


1 


8.2 


1 3.1 





O 

ERIC 



3S 
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CHAPTER 3 

RESULTS AND INTERPRETATION 

Results reported in this chapter are based on data collected in 
Jordan in December 1986 and December 1987. Approximately 1,300 
children in 13 schools and 100 adults in 6 literacy training classes 
were tested each year. In 1987, both groups responded to questions 
about AL MANAAHIL. In addition, approximately five hundred teachers, 
parents, and other adults, in two separate surveys, responded to 
questions about their familiarity with, exposure to, and perceptions 
of AL MANAAHIL. 

3 . 1 Impact on Student Achievement 

Children's performance on Arabic reading tests provided the most 
conclusive evidence about the impact of AL MANAAHIL on children's 
reading skills. Teachers, parents, and other adults, in responding to 
questionnaires administered in the evaluation, provided additional 
evidence about the impact of AL MANAAHIL on the reading skills of Arab 
children. 

The reading tests used to assess reading skills and knowledge of 
MSA were described in Chapter 2. Briefly, 160 reading items were 
developed and grouped into 8 subtests, a core test containing subtests 
3 and 4, and four grade specific tests containing combinations of 4, 

5, or 6 subtests appropriate for the grade being tested. The results 
of the test administrations in December 1986 and December 1987 are 
presented in three summary tables : 

(1) Table 3.1.1 : Grade Level Test Results by School and Grade; 

(2) Table 3.1.2 : Core Test Results by School and Grade; and 

(3) Table 3.1.3 : Subtest Results by Grade. 
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Table 3.1.1 



Grade Level Teat Results br Sdiool and Grade 



j GKM)E 


SCHOOL 


DECaeCR 1966 
NUNKt ICAM 




1 


I 


40 


19.05 






C 


39 


22.82 






G 


27 


26.95 






A 


97 


29.70 






TOTAL 


203 


25.91 




2 


A 


92 


38.34 






B 


46 


38.46 






C 


53 


41.21 






D 


54 


44.72 






E 


54 


46.31 






F 


96 


48.14 






G 


29 


49.17 






H 


60 


51.35 






I 


41 


52.22 






J 


84 


64.57 






TOTAL 


611 


47.73 




3 


E 


48 


49.81 






B 


47 


51.70 






I 


38 


59.89 






F 


55 


68.13 






J 


60 


70.30 






TOTAL 


248 


60.73 




4 


K 


34 


66.79 






H 


99 


67.10 






C 


46 


69.61 






F 


77 


80.35 






L 


45 


82.31 






0 


22 


87.59 






TOTAL 


3Z3 


74.10 



II DECBWBI 19W 
S.D. II MUNBER NEM S.D. 

— = 11 — — 

II 



7.31 


II 


41 


34.20 


13.09 


6.09 


II 


31 


24.29 


5.82 


11.99 


II 


32 


31.13 


8.86 


14.67 


II 


71 


35.80 


8.57 




II 








12.50 


II 


175 


32.53 


10.31 




II 








18.06 


II 


72 


52.54 


13.08 


11.90 


II 


55 


52.31 


13.02 


12.01 


II 


51 


42.22 


15.73 


15.30 


II 


35 


45.74 


9.03 


14.24 


II 


54 


55.89 


14.88 


22.48 


II 


50 


58.82 


12.84 


10.65 


II 


29 


55.55 


11.28 


11.95 


II 


67 


46.72 


11.99 


15.86 


II 


28 


62.36 


13.96 


12.47 


II 


69 


67.71 


9.93 




II 








17.66 


II 


510 


53.98 


14.75 




II 








12.90 


II 


46 


59.76 


18.23 


14.95 


II 


56 


64.73 


15.07 


17.18 


II 


19 


69.58 


19.02 


17.02 


II 


42 


68.43 


20.59 


10.40 


II 


69 


72.14 


10.80 




II 








16.73 


II 


232 


67.02 


16.66 




II 








19.56 


II 


30 


97.20 


12.51 


21.27 


II 


72 


74.99 


16.24 


15.36 


II 


40 


63.68 


22.19 


17.83 


II 


27 


95.81 


15.88 


14.44 


II 


52 


8S.12 


17.15 


19.57 


II 


42 


96.36 


8.68 




II 








19.83 


II 


263 


83.35 


20.00 



II 

II 


1 

87-86 1 T-VALUE 

I 


9-VALUE 


j SIGNIF 




II 

II 

II 


1 

1 

15.15 1 


6.41 


0.00 




♦++ 




II 


1.47 1 


1.02 


0.31 




NS 




II 


4.20 1 


1.54 


0.13 




NS 




II 


6.10 I 


3.13 


0.00 




♦++ 




II 

II 


1 

6.62 1 


5.56 


0.00 




♦++ 




II 

II 


1 

14.20 1 


5.62 


0.00 




♦++ 




II 


13.85 I 


5.60 


0.00 




♦++ 




II 


1.01 1 


0.37 


0.71 




NS 




II 


1.02 I 


0.36 


0.72 




NS 




II 


9.58 1 


3.44 


0.00 




♦++ 




II 


10.68 1 


3.10 


0.00 




♦++ 




II 


6.38 I 


2.21 


0.03 




-*-#■ 




II 


-4.63 1 


-2.18 


0.03 




— 




II 


10.14 I 


2.73 


0.01 








II 


3.14 I 


1.70 


0.09 




NS 




II 

II 


1 

6.25 1 


6.35 


0.00 




♦++ 




II 

II 


1 

9.95 1 


3.06 


0.00 




♦++ 




II 


13.03 1 


4.39 


0.00 




♦++ 




II 


9.69 1 


1.94 


0.06 




NS 




II 


0.30 1 


0.06 


0.94 




NS 




II 


1.84 1 


0.96 


0.35 




NS 




II 

II 


1 

6.29 1 


4.12 


0.00 




♦++ 




II 

II 


1 

30.41 1 


7.29 


0.00 




♦++ 




II 


7.89 1 


2.64 


0.01 




•M-l- 




II 


-5.93 1 


-1.46 


0.15 




NS 




II 


15.46 1 


3.96 


0.00 




4-M- 




II 


2.81 1 


0.86 


0.39 




NS 




II 


8.77 1 


2.49 


0.02 




♦♦ 




II 

II 


1 

9.25 1 


5.60 


0.00 










♦+♦/ — si 9 iific«nt at .01 level 
tiviif leant at .05 level 
KS not alffiificant (p^.OS) 



;o 
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Table 3.1.2 

Core Test Results bf School and Grade 



j GRADE j 


SCHOOL 


DECanER 

NUMBER ICAN 


1966 

S.D. 


II DECB«ER 1987 

II NUMBER NEM S.D. 


II 

II 
>1 1 


87-86 


T-VALUE 


1 

1 P-VALUE 
-1 


SIGNIF 














■|l 

II 








*11 

II 






1 

1 








1 1 i 


I 


40 


5.55 


4.14 


II 


41 


16.46 


7.17 


II 


7.88 


6.04 


1 


0.00 








C 


39 


9.87 


3.60 


II 


31 


11.52 


4.01 


II 


1.65 


1.81 


1 


0.08 


NS 






G 


27 


12.59 


6.27 


II 


32 


14.88 


5.74 


II 


2.29 


1.46 


1 


0.15 


NS 






A 


97 


14.54 


7.34 


II 


71 


16.61 


4.91 


II 

tl 


2.07 


2.06 


1 

1 


0.04 


+♦ 






TOTAL 


203 


12.21 


6.53 


II 

II 


175 


15.35 


5.81 


II 

II 


3.14 


4.91 


1 

1 


0.00 
















II 








II 






1 








1 2 i 


A 


92 


18.78 


8.21 


II 


72 


23.43 


5.70 


II 


4.65 


4.09 


1 


0.00 


4 -M- 






B 


45 


17.19 


6.75 


II 


55 


24.91 


5.78 


II 


7.72 


6.25 


1 


0.00 








C 


53 


19.95 


6.00 


II 


51 


17.47 


6.87 


II 


-2.51 


-1.99 


1 


0.05 


-- 






D 


54 


18.95 


6.33 


II 


35 


18.26 


4.91 


II 


-0.72 


-0.57 


1 


0.57 


NS 






E 


54 


20.17 


7.09 


II 


54 


24.85 


6.24 


II 


4.68 


3.65 


1 


0.00 








F 


96 


21.58 


8.33 


II 


50 


25.94 


4.81 


II 


4.36 


3.41 


1 


0.00 








G 


29 


23.24 


5.77 


II 


29 


23-79 


5.89 


II 


0.55 


0.36 


1 


0.72 


NS 






H 


60 


23.97 


4.00 


II 


67 


20.97 


6.49 


II 


-3.00 


-3.09 


1 


0.00 


— - 






I 


41 


24.41 


6.98 


II 


28 


28.11 


5.96 


II 


3.70 


2.29 


1 


0.03 


♦+ 






J 


84 


27.23 


4.97 


II 


69 


28.10 


4.32 


II 


0.87 


1.15 


1 


0.25 


NS 














II 








II 






1 










TOTAL 


611 


21.60 


7.36 


II 


510 


23.62 


6.62 


II 
1 1 


2.02 


4.79 


1 

1 


0.00 






13 I 


E 


45 


25.13 


4-73 


II 

II 


46 


24.54 


7.93 


M 

II 


-0.59 


-0.43 


1 

1 


0.67 


NS 






B 


47 


24.79 


5.26 


II 


56 


28.11 


4.77 


II 


3.32 


3.36 


1 


0.00 








I 


35 


28.58 


6.84 


II 


19 


32.21 


6.70 


II 


3.63 


1.90 


1 


0.06 


NS 






F 


55 


30.04 


6.63 


II 


42 


31.02 


7.48 


II 


0.98 


0.69 


1 


0.49 


NS 






J 


60 


31.57 


4.31 


II 


69 


31.41 


4.37 


II 


-0.16 


-0.21 


1 


0.83 


NS 














II 








II 






1 










TOTAL 


245 


28.24 


6.17 


II 


232 


29.25 


6.64 


II 


1.01 


1.72 


1 


0.09 


NS 














II 








II 






1 








1 ^ I 


1C 


34 


26.65 


6.07 


II 


30 


34.77 


4.36 


II 


8.12 


6.08 


1 


0.00 


•l-M- 






H 


99 


27.35 


7.35 


II 


72 


30.46 


5.31 


II 


3.11 


3.05 


1 


0.00 








C 


46 


28.41 


5.70 


II 


40 


27.63 


8.47 


II 


-0.78 


-0.51 


1 


0.61 


NS 






F 


77 


30.23 


5.92 


II 


27 


35.00 


5.23 


II 


4.77 


3.70 


1 


0.00 








L 


45 


32.09 


3.19 


II 


52 


33.12 


4.71 


II 


1.03 


1.24 


1 


0.22 


NS 






D 


22 


31.73 


4.36 


II 


42 


37.14 


2.20 


II 
1 1 


5.41 


6.63 


1 

1 


0.00 


4 -M- 






TOTAL 


323 


29.07 


6.27 


M 

II 


263 


32.58 


6.14 


II 

II 


3.51 


6.79 


1 

1 


0.00 


1 



♦++/ — sfsa^if leant at .01 level 
♦+/-- sIsRilflcant at .05 level 
NS not significant (p>.05) 
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T^le 3.1.3 

Siiitest Results fay Crade 



GRADE 


SUBTEST 


1 DECEHBER 1966 

1 NUMBER MEAN S.D. 


II DECaVER ' 

11 NUMBER MEAN 


1987 

S.D. 


II 

II 

-1 1- 


87-86 


T-VALUE 


1 

1 P-VALUE 
=1 












II 








II 






1 














II 








II 






1 




1 


1 


i 203 


6.95 


3.77 


II 


175 


8.72 


3.49 


II 


1.77 


4.72 


1 


0.00 




2 


1 203 


6.76 


3.70 


II 


175 


8.46 


2.76 


II 


1.70 


4.99 


1 


0.00 




3 


1 203 


8.47 


4.31 


II 


175 


10.18 


4.23 


II 


1.71 


3.88 


1 


0.00 




4 


1 203 


3.73 


2.77 


II 


175 


5.17 


2.48 


II 


1.44 


5.28 


1 


0.00 












II 








II 






1 




2 


2 


1 611 


11.69 


4.25 


II 


510 


13.22 


3.48 


II 


1.53 


6.48 


1 


0.00 




3 


1 611 


14.16 


4.77 


II 


510 


15.40 


4.50 


II 


1.24 


4.44 


1 


0.00 




4 


1 611 


7.44 


3.28 


II 


510 


8.22 


2.88 


II 


0.78 


4.19 


1 


0.00 




5 


1 611 


7.84 


4.05 


II 


510 


8.97 


3.40 


II 


1.13 


5.00 


1 


0.00 




6 


1 611 


6.60 


4.65 


II 


510 


8.17 


4.41 


II 


1.57 


5.78 


1 


0.00 












II 








II 






1 




3 


3 


1 248 


18.14 


4.01 


II 


232 


18.61 


4.40 


II 


0.47 


1.22 


1 


0.23 




4 


1 248 


10.10 


2.84 


II 


232 


10.64 


2.74 


II 


0.54 


2.12 


1 


0.03 




5 


1 247 


11.53 


4.35 


II 


232 


12.76 


4.06 


II 


1.25 


3.21 


1 


0.00 




6 


1 247 


11.62 


4.83 


II 


232 


13.25 


4.45 


II 


1.63 


3.86 


1 


0.00 




7 


1 247 


9.49 


3.54 


II 


232 


11.75 


4.06 


II 


2.26 


6.53 


1 


0.00 












II 








II 






1 




4 


3 


1 323 


18.55 


4.31 


II 


263 


20.92 


3.84 


II 


2.37 


7.95 


1 


0.00 




4 


I 323 


10.53 


2.65 


II 


263 


11.66 


2.84 


II 


1.13 


4.99 


1 


0.00 




5 


1 323 


11.92 


4.11 


II 


263 


13.84 


4.24 


II 


1.92 


5.55 


1 


0.00 




6 


I 323 


13.27 


4.75 


II 


263 


14.87 


4.52 


II 


1.60 


4.15 


1 


0.00 




7 


1 323 


11.20 


3.96 


II 


263 


12.56 


3.83 


II 


1.36 


4.20 


1 


0.00 




8 


1 323 


8.64 


3.75 


II 


263 


9.51 


3.94 


II 


0.87 


2.72 


1 


0.01 












II 








II 






1 





— significant at .01 level 
♦+/-- significant at .05 level 
NS not significant <p^.05) 
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In Column 2 of Tables 3.1.1 and 3.1.2, each school is identified 
by a letter. Because Grade 2 was the major focus of the study, 
letters were assigned in order of the school ^s average (Mean) score on 
the Grade 2 test in 1986. School A had the lowest score on the Grade 
2 test. School J the highest. The same letters were used to identify 
the school if it participated in Grades 1, 3, or 4. Two schools 
participated only in Grade 4, School K and School L. One school did 
not test children in the same grade in 1986 and 1987 and was therefore 
not included in this component of the evaluation. After the schools 
within a grade were listed, TOTAL was used to indicate all children in 
that grade. For example, in Grade 1, four schools participated in 
1986 with a total of 203 children. 

Although each table is discussed in detail in this chapter of the 
report, the overall results for each can be summarized briefly as 
follows : 

(1) Results on the Grade Level Tests (Table 3.1.1) show that AL 
MANAAHIL had a significant positive impact on Arab 
children's reading skills in each of the four grades 
studied. 

(2) Results on the Core Test (Table 3.1.2) reinforce the 
conclusion that AL MANAAHIL had a positive impact and 
provide useful information on student growth across Grades 1 
through 4. 

(3) Results on the 8 Sub tests (Table 3.1.3) indicate that the 
conclusion of a positive impact is valid across a wide range 
of goals and objectives of the series. 

Because the formats of the tables are similar, we give a description 
of each column label on the next page for Tables 3.1.1, 3.1.2, and 
3.1.3. In the sections following, we present a detailed discussion of 
the information contained in each table. 
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Description of labels used in Tables^ 3.1.1 th rough 3.1.3 



Column Label Description 



1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 



GRADE - Children in Grades 1, 2, 3, and 4 were tested. 

SCHOOL - Twelve schools (A through L) participated. 

NUMBER - Number of children in grade/school in 1986. 

MEAN - Average score on the Grade Level Test in 1986. 

S.D. - Standard deviation of children's scores in 1986. 

NUMBER - Number of children in grade/school in 1987 . 

MEAN - Average score on the Grade Level Test in 1987. 

S.D. - Standard deviation of children's scores in 1987. 

87-86 - Average in 1987 minus Average in 1986. 

T-VALUE - A standardized measure of the 87-86 difference 
based on the sizes of the samples and the 
standard deviations of the scores. 

P-VALUE - Probability of getting a T-VALUE as high as that 
given in column 10 by chance . 

SIGNIF - Significance of the difference using conventions 
based on P -VALUES less than .05 or .01. 



NOTES : +++/ — the difference 87-86 is significant beyond 

a .01 level of significance. 



++/-- the difference 87-86 is significant beyond 
a .05 level of significance. 

NS the difference 87-86 is not significant beyond 
a .05 level of significance. 
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Grade Level Tests . In Table 3.1.1, there are twenty- five grade 
by school comparisons - four in Grade 1, ten in Grade 2, five in Grade 
3, and six in Grade 4. In column 9, the difference 87-86 is positive 
in 23 of the 25 comparisons. If the children in the schools were 
similar in 1986 and 1987, we would expect about half the scores to go 
up a little and half to go down a little. Therefore, we expect about 
50% of the differences 87 - 86 to be positive. The fact that 23 of 25, 
or 92%, of the differences are positive is an indication that 
something happened across the schools to improve the children's 
reading skills. Most of the differences are statistically 
significant given the sample sizes and standard deviations of the 
scores . 

AL MANAAHIL was seen by the vast majority of these children. 

Its goals and objectives were to improve the reading skills of the 
children in areas corresponding to the Grade Level Tests. Therefore, 
one explanation for the increase in test scores is that Arab children 
learned some of the material from watching the television programs, 
that some of the teachers incorporated some of the material from the 
television series into their instruction, and that some of the parents 
helped the children to understand better some of the material 
presented in the AL MANAAHIL programs. 

Although we cannot prove that the increase in test scores was due 
to AL MANAAHIL, we can consider and eliminate some alternative 
suggestions for the increase. Could familiarity with the tests 
account for the increase in scores? Actually, only a small percentage 
(less than 20%) of the children participated in both years. In 1987, 
they were in a different grade than they were in in 1986, and they 
responded to a different grade specific test. There were some items 
common to all tests, but the numbers of items and children in any one 
grade was small. A review of the Grade 2 scores on the Core Test in 
1987 for the four schools in the 1986 Grade 1 sample does not appear 
to indicate a systematic advantage. 
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At the aggregate level, the results are positive and highly 
significant in each of the grades in the study. Of course, the 
significance is related to the sizes of the samples. In larger 
samples, smaller differences will be statistically significant. 

A common way of judging the substantive nature of the difference is 
to compare it to the standard deviations of the scores in the samples. 
The differences in this study, about one -third to one -half of the 
standard deviations of the sample scores, are fairly large and more 
than adequate evidence of a positive effect. The results are presented 
graphically in Figures 1 and 2. 

In Figure 1, the white bars correspond to the average test scores 
in 1986 (i.e., Grade 1: 25.9; Grade 2: 47.7; Grade 3: 60.7; and Grade 
4: 74.1). The black bars correspond to the average test scores in 
1987 (i.e.. Grade 1: 32.5; Grade 2: 54.0; Grade 3: 67.0; and Grade 4: 
83.4). In all four grades, the children in 1987 scored higher than 
those in 1986. In Grades 1, 2, and 3, the 1987 group scored 
approximately 6 units higher than the 1986 group. In Grade 4, the 
1987 group scored about 9 units higher than the 1986 group. The 
differences are highly significant in every grade. 

In Figure 2, the white bars correspond to average scores for 
children in specific grades within schools in 1986. The black bars 
correspond to average scores for children in the same grades and 
schools in 1987. Two of the groups in 1987 scored lower than the 
corresponding groups in 1986 - those in Grade 2 in School H and those 
in Grade 4 in School C. These results show that the increases in 
reading performance summarized at the grade levels in Graph 1 were 
widespread across different types of schools. Once again, it is 
important to note that the comparison is between children in the same 
grade over a one year period. That is, in the same schools, children 
in Grade 2 in 1987, after AL MANAAHIL was on television, scored 
significantly higher than children in Grade 2 in 1986, before AL 
MANAAHIL was shown on television. 
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ARABIC READING TEST RESULTS 

1988 - 1987 




1988 GROUP 
1987 GROUP 




-I 1 1 1 1 1 

0 20 40 60 80 100 

FIGURE 1: Comparison of Grade Level Scores by Grade 
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ARABIC READING TEST RESULTS 

1986 ** 1987 



GRADE 1 



GRADE 2 



GRADE 3 




GRADE 4 




1988 GROUP 




1987 GROUP 



0 20 40 60 80 100 



FIGURE 2: Comparison of Grade Laval Scores by School 
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Core Test . In Table 3.1.2, we present the results on the Core 
Test, a 40 item test taken by all students. One value of the Core 
Test is that it allows us to examine achievement across grades. For 
example, the mean scores of children in Grades 1, 2, 3, and 4 in 1986 
were 12.2, 21.6, 28.2, and 29.1. This test was appropriate for Grade 
2 children, difficult for Grade 1 children, and relatively easy for 
children in Grades 3 and 4. The results show evidence of growth 
across the grades. They support the assertions that AL MANAAHIL is 
most relevant to the Grade 2 curriculum; that it makes sense for 
children in Grades 1, 3, and 4; and, that it supplements learning 
already taking place. 

Of 25 school differences ( 87-86 ) in column 9, 19 were positive. 

We expected to find fewer significant differences in Grades 3 and 4 
because of a tendency toward a ceiling effect on the test. However, 
the results in Grade 4 are very positive. An interesting line of 
research would be to examine whether the increase in scores is due to 
performance on special items. The results are presented graphically 
in Figures 3 and 4. 

Subtests . In Table 3.1.3, we present the results on each subtest 
by grade combination. These results are interesting because they show 
clearly that performance on each subtest increases as the children 
move from Grade 1 to Grade 4. The increases across Grades 1 through 4 
provide guides for interpreting the increases within grades between 
1986 and 1987. Although differences ( 87-86 ) in column 9 are small, 
they are positive in all cases. By and large, the results are highly 
significant. The results are presented graphically in Figure 5. 

Sex differences . Thus far, results indicate that AL MANAAHIL' s 
positive impact is verified across schools, grades, and curriculum 
areas. We also examined the results by sex of the students. In Table 
3.1.4, we present the results by sex within school and grade. Note 
that some schools were single sex schools. Although we expected this 
analysis to provide only a further indication that the positive effect 
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ARABIC READING TEST RESULTS 

1986 - 1987 



GRADE 1 



GRADE 2 



GRADE 3 



GRADE 4 






1988 GROUP 



1987 GROUP 



0 10 20 30 40 

FIGURE 3: Comparison of Core Test Scores by Grade 
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ARABIC READING TEST RESULTS 

1986 - 1987 



GRADE 1 I 
C 
Q 
A 

GRADE 2 B 
A 
D 
C 
E 
F 
Q 
H 
I 

J 

GRADE 3 B 
E 
I 

F 

J 

GRADE 4 K 
H 
C 
F 
D 
L 



1986 GROUP 

1987 GROUP 



10 



20 



30 



40 



FIGURE 4: Comparioon of Core Test Scores by School 
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SUBTEST 1 Q1 - 

SUBTEST 2 01 
G2 

SUBTEST S 01 
02 
OS 

04 

SUBTEST 4 01 
02 

05 
04 

SUBTEST 5 02 

03 

04 

SUBTEST 6 02 

05 
04 

SUBTEST 7 OS 
04 

SUBTEST 8 04 



ARABIC READING TEST RESULTS 

1088 - 1087 



1088 GROUP 
1087 GROUP 



10 15 20 25 



FIGURE 5: Comparison of Subtest Scores by Grade 
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Table 3.1.4 

Results for Boys and Girls 



1 

TEST 1 


GRADE 


1 1 

1 SEX 1 


DECEMBER 1986 | 

NUMBER MEAN S.D. | 


DECEMBER 1987 
NUMBER MEAN S.D. 


II 

II 


87-86 




Total 1 


1 


1 H 1 


173 


26.07 


1 

12.81 1 


147 


32.50 


10.54 


■| r 
II 


6.43 




1 

1 




1 F 1 
1 1 


29 


25.34 


10.66 1 


28 


32.71 


9.13 


II 


7.37 




1 

I 


2 


I I 

1 ^ 1 


302 


43.01 


1 

16.45 1 


261 


51.33 


15.45 


1 1 
II 


8.32 




1 

1 




1 F 1 
1 1 


309 


52.35 


17.60 1 


249 


56.77 


13.43 


II 


4.42 




1 

1 


3 


i I 

1 ^ 1 


102 


58.36 


1 

17.17 1 


71 


62.20 


18.41 


1 1 
II 


3.84 




1 

1 




1 F 1 
1 1 


146 


62.39 


16.27 1 


161 


69.14 


15.40 


II 


6.75 




1 

1 


4 


1 1 
1 ^ 1 


112 


73.12 


1 

17.62 1 


71 


72.13 


23.28 


1 1 
II 


-0.99 




1 

1 




1 F 1 
1 1 


211 


74.62 


20.93 1 
1 


191 


87.40 


16.89 


II 

II 


12.78 




1 

Core 1 


1 


1 1 
1 ^ 1 


173 


12.28 


1 

6.64 1 


147 


15.41 


5.83 


II 

II 


3.13 




1 

1 




1 F 1 

1 1 


29 


11.93 


6.01 1 


28 


15.07 


5.79 


II 


3.14 




1 

1 


2 


1 1 
1 ^ 1 


302 


20.26 


1 

7.34 1 


261 


22.67 


6.95 


1 1 
II 


2.41 




1 

1 




1 F 1 


309 


22.91 


7.16 1 
1 


249 


24.62 


6.10 


II 


1.71 




1 

1 


3 


1 1 

1 ^ 1 


102 


27.76 


1 

6.20 1 


71 


27.08 


8.12 


1 1 
II 


-0.68 




1 

1 




1 F 1 
1 1 


146 


28.57 


6.14 1 


161 


30.20 


5.64 


II 


1.63 




1 

1 


4 


1 1 
1 ^ 1 


112 


29.04 


1 

6.11 1 


71 


29.93 


7.75 


1 1 
II 


0.89 




1 




1 F 1 


211 


29.09 


6.37 1 


191 


33.53 


5.11 


II 


4.44 
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of AL MANAAHIL was confirmed for boys and girls, we were surprised by 
the results. 

In Grade 1, the results are about the same for boys and girls. 

In Grades 2 and 3, the results are somewhat more positive for girls 
than boys. In Grade 4, results are primarily positive for girls and 
are not significantly positive for boys. These results support the 
evidence for an overall positive impact of AL MANAAHIL, but they raise 
questions about a differential impact by sex of student. 

Special items . As explained above, there is one serious weakness 
in the interpretation given thus far. Although it is clear that 
children in 1987 performed better than those in 1986, it can be argued 
that the improvement would have occurred without AL MANAAHIL. 

Although we have no indication to lead us to believe that any changes 
occurred in the schools that would account for the results presented, 
nevertheless, it is possible that the improvement might have been due 
to an event or program other than AL MANAAHIL. 

To provide evidence that the improvement in performance was due 
to AL MANAAHIL, we examined a subset of items clearly related to very 
specific objectives of the AL MANAAHIL series. Using the item 
descriptions in Appendix B, 33 items directly related to very explicit 
and specific goals were selected for further examination. A list of 
the items and the corresponding student response task is given on the 
next page. The complete listing of •’Percent Correct” response rates 
by Grade is given in Table 3.1.5 for all items administered in 1986 
and 1987. Special items are indicated by asterisks. 

One item (Item 49) had been retained in the test in spite of poor 
performance in the pilot testing in May 1986. The item tested 
children’s knowledge of ”Haafila,” the MSA word for bus. The item 
response data in May 1986 were technically inadequate to meet certain 
test standards used at ETS. We suggested deleting the item from the 
overall test. Dr. Muhammad Ibrahim strongly suggested that this item 
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Special Items in the Arabic Reading Test 



Item 



Student Rcstx>nsc 



6 Recognizes the word that includes the letter (gh) in medial form. 

7 Recognizes the word that includes the letter (H) in medial form. 

8 Recognizes the word that includes the letter (K) in final form. 

9 Specifies the letter "KaaP at the end of a given word. 

26 Recognizes the word that includes the letter (y) in medial form. 

27 Recognizes the word that includes the letter (9) in initial form. 

28 Identifies the word that has a connected form of the letter "taa." 

29 Specifies the letter "DHaa" at the beginning of a given word. 

32 Given a question, recognizes it should end with a question mark. 

40 Recognizes the word that represents two of the same thing among other words similar in sound and shape. 

41 Discriminates Zaay from Raa. 

42 Discriminates Thaa from Yaa, Baa, and Nuun. 

43 Discriminates Dhaal from Daal. 

44 Discriminates Siin from Shiin. 

45 Discriminates Dhaa from Taa. 

46 Discriminates Qaaf from Faa, and Saad from Daad. 

47 Discriminates Qaaf from Faa. 

49 Recognizes the word "Haafilah" meaning "bus." 

66 Recognizes the numeral used in Eastern Arab countries that corresponds to the numeral 8 used in Western Arab countries. 

67 Recognizes the letter that comes next in order after a series of 4 ordered letters. 

78 Recognizes the expression to be used when visiting a person that has recently come back from a trip or journey. 

82 Specifics the letter in a four-letter word that has the "sukuun" sign. 

83 Specifies the letter in a four-letter word that has the "shaddha* sign. 

84 Recognizes one word in which "al" ("the") is pronounced (while in the other words it is not). 

85 Recognizes one word in which "al" ("the") is not pronounced (while in the other words it is). 

94 Recognizes that the form "rijaalun" ("men") is the right plural of the noun "rajulun" ("man"). 

101 Recognizes the meaningful grouping of words. 

106 Recognizes the appropriate contextual answer to a statement followed by a question: "Samiir opened his bag and put his books 
in it; where did he go after that?" 

109 Chooses one word "Al-ghazaal" as an answer to the question requiring an inference from the information given. 

123 Recognizes the word (broken plural) that represents more than two, among other words similar in sound and written shape. 

124 Recognizes the word representing one thing among oth-.r words having similar sounds but which are plural in meaning. 

125 Recognizes the word "Ia9ibuu" ("they played") written correctly while the other given words are not. 

150 Given 4 names, identifies which comes first in the telephone directory. 
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Table 3.1.5 

Percent of Children Responding Correctly to Test Itens 
by Grade and Year with Special I teas Noted by Asterisk 



j Sub test 


1 

1 Item 


Grade 

1986 


1 

1987 




Grade 

1986 


2 1 Grade 3 

1987 1 1986 1987 


1 Grade 4 | 

1 1986 19871 

•1 1 


1 1 


■I 

1 1 


69 


55 








' 'i 


1 1 
1 1 




1 2 


13 


14 








1 


1 




1 3 


50 


69 








1 


1 




1 ^ 


47 


40 








1 


1 




1 


30 


23 








1 


1 




1 6 


38 


75 








1 


1 




1 7* 


30 


54 








1 


1 




1 8* 


58 


74 








1 


1 




1 9* 


41 


56 








1 


1 




1 10 


16 


22 








1 


1 




1 11 


11 


28 








1 


1 




1 12 


14 


25 








1 


1 




1 13 


50 


62 








1 


1 




1 1^ 


29 


35 








1 


1 




1 13 


35 


45 








1 


1 




1 16 


34 


44 








1 


1 




1 17 


18 


23 








1 


1 




1 18 


38 


57 








1 


1 




1 19 


35 


31 








1 


1 




1 20 


39 


38 








1 

1 


1 

1 


1 2 


1 

1 21 


53 


70 






91 


95 1 


1 

1 




1 22 


55 


57 






90 


86 1 


1 




1 23 


40 


44 






56 


54 1 


1 




1 24 


37 


25 






32 


38 1 


1 




1 25 


27 


22 






21 


29 1 


1 




1 26* 


45 


60 






76 


82 1 


1 




1 27* 


29 


49 






74 


76 1 


1 




1 28* 


46 


55 






77 


78 1 


1 




1 29* 


27 


32 






60 


63 1 


1 




1 30 


37 


59 






80 


85 1 


1 




1 31 


30 


25 






48 


58 1 


1 




1 32* 


37 


44 






62 


68 1 


1 




1 33 


17 


32 






54 


63 1 


1 




1 34 


37 


40 






60 


84 1 


1 




1 35 


28 


45 






51 


68 1 


1 




1 36 


29 


40 






52 


77 1 


1 




1 37 


23 


44 






42 


55 1 


1 




1 38 


44 


35 






61 


55 1 


1 




1 39 


19 


33 






58 


70 1 


1 




1 40* 


15 


34 






26 


40 1 


1 
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Table 3.1.5 ( continued) 

Percent of Children Responding Correctly to Test Items 
by Grade and Year vlth Special Items Noted by Asterisk 



1 Sub test 


1 

1 


Item 


Grade 

1986 


1 

1987 


Grade 

1986 


2 

1987 


Grade 

1986 


3 

1987 


Grade 

1986 


^ 1 
1987 1 


1 3 


1 

1 


41* 


50 


62 


84 


87 


89 


90 


92 


96 1 




1 


42* 


60 


54 


78 


80 


92 


91 


87 


95 1 




1 


43* 


39 


50 


68 


70 


80 


86 


83 


92 1 




1 


44* 


56 


62 


83 


88 


92 


91 


94 


96 1 




1 


45* 


22 


34 


72 


78 


88 


88 


91 


94 1 




1 


46* 


33 


55 


79 


87 


92 


91 


92 


95 1 




1 


47* 


36 


42 


61 


68 


79 


76 


75 


85 1 




1 


48 


36 


46 


34 


43 


48 


58 


57 


64 1 




1 


49* 


13 


14 


10 


27 


15 


32 


13 


56 1 




1 


50 


11 


33 


53 


68 


85 


82 


83 


89 1 




1 


51 


41 


41 


75 


78 


87 


84 


79 


88 i 




1 


52 


28 


24 


41 


41 


54 


59 


55 


68 1 




1 


53 


33 


26 


55 


61 


72 


73 


76 


84 1 




1 


54 


28 


34 


31 


35 


54 


58 


63 


79 1 




1 


55 


31 


22 


19 


23 


42 


45 


43 


67 1 




1 


56 


25 


17 


36 


35 


56 


62 


56 


85 1 




1 


57 


33 


23 


48 


47 


69 


60 


65 


73 1 




I 


58 


19 


11 


8 


6 


14 


25 


45 


57 1 




1 


59 


32 


49 


68 


71 


84 


85 


73 


77 1 




1 


60 


37 


53 


72 


77 


92 


91 


92 


96 1 




1 


61 


46 


67 


76 


84 


92 


92 


90 


96 1 




1 


62 


28 


45 


72 


82 


92 


93 


95 


97 1 




1 


63 


52 


55 


85 


84 


96 


94 


94 


98 1 




I 


64 


40 


61 


71 


72 


89 


85 


90 


89 1 




1 


65 


22 


38 


40 


50 


63 


71 


72 


78 1 


1 ^ 


1 

I 


66* 


67 


88 


89 


95 


98 


98 


96 


95 1 




1 


67* 


26 


47 


39 


42 


46 


58 


48 


60 1 




1 


68 


32 


31 


57 


57 


62 


59 


49 


72 1 




I 


69 


28 


27 


34 


38 


61 


66 


62 


75 1 




I 


70 


39 


34 


76 


76 


91 


91 


92 


96 1 




1 


71 


14 


25 


62 


73 


87 


82 


89 


92 1 




1 


72 


26 


26 


52 


59 


73 


77 


69 


87 1 




1 


73 


13 


9 


16 


27 


42 


59 


56 


67 1 




1 


74 


27 


41 


52 


58 


59 


66 


72 


77 1 




I 


75 


24 


43 


41 


45 


44 


39 


46 


58 1 




I 


76 


23 


53 


49 


63 


67 


75 


66 


83 1 




1 


77 


12 


23 


30 


38 


40 


52 


48 


54 1 




I 


78* 


18 


27 


40 


45 


76 


79 


87 


83 1 




1 


79 


15 


19 


53 


63 


82 


85 


89 


87 1 




1 


80 


11 


22 


52 


45 


82 


79 


84 


81 1 




57 
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Table 3,1.5 (continued) 

Percent of Children Responding Correctly to Test Items 
by Grade and Year with Special Items Noted by Asterisk 



j Subtest 


1 

1 Item 


1 

1 

■ 


Grade 1 
1986 1987 


1 Grade 

1 1986 
1 


2 

1987 


( Grade 
1 1986 


3 

1987 


1 Grade 
1 1986 


4 1 
19871 


1 5 


-i- 

1 


81 


■I 

1 




‘1 

1 


57 


59 


1 

1 


68 


70 


1 

1 


68 


80 1 




1 


82* 


1 




1 


35 


46 


1 


60 


61 


1 


33 


44 1 




1 


83* 


1 




1 


54 


60 


1 


65 


76 


1 


67 


76 1 




1 


84* 


1 




1 


31 


38 


1 


60 


72 


1 


64 


69 1 




1 


85* 


1 




1 


43 


38 


1 


56 


70 


1 


63 


67 1 




1 


86 


1 




1 


54 


58 


1 


75 


76 


1 


79 


88 1 




1 


87 


1 




1 


32 


43 


1 


53 


63 


1 


62 


70 1 




1 


88 


1 




1 


44 


47 


1 


56 


63 


1 


66 


72 1 




1 


89 


1 




1 


57 


61 


1 


55 


70 


1 


59 


69 1 




1 


90 


1 




1 


23 


28 


1 


56 


57 


1 


61 


72 1 




1 


91 


1 




1 


32 


42 


1 


51 


66 


1 


58 


74 1 




1 


92 


1 




1 


25 


27 


1 


40 


33 


1 


39 


54 1 




1 


93 


1 




1 


43 


49 


1 


70 


73 


1 


66 


71 1 




1 


94* 


1 




1 


26 


38 


1 


52 


57 


1 


63 


73 1 




1 


95 


1 




1 


31 


40 


1 


62 


72 


1 


59 


80 1 




1 


96 


1 




1 


21 


24 


1 


15 


33 


1 


22 


37 1 




1 


97 


1 




1 


67 


68 


1 


95 


93 


1 


93 


89 1 




1 


98 


1 




1 


56 


66 


1 


77 


82 


1 


83 


87 1 




1 


99 


1 




1 


34 


37 


1 


48 


49 


1 


44 


52 1 




1 


100 


1 




1 


19 


28 


1 


41 


42 


1 

1 


45 


1 


1 6 


1 

1 


101* 


1 

1 




1 

1 


39 


40 


1 

1 


72 


78 


1 

1 


80 


84 1 




1 


102 


1 




1 


39 


40 


1 


66 


74 


1 


72 


85 1 




1 


103 


1 




1 


43 


43 


1 


71 


79 


1 


85 


85 1 




1 


104 


1 




1 


33 


32 


1 


57 


73 


1 


75 


80 1 




1 

1 


105 


1 




1 


17 


21 


1 


15 


39 


1 


38 


48 1 




1 


106* 


1 




1 


39 


55 


1 


73 


84 


1 


76 


83 1 




1 

1 


107 


1 




1 


65 


74 


1 


79 


90 


1 


83 


93 1 




1 


108 


1 




1 


32 


41 


1 


59 


60 


1 


60 


73 1 




1 

1 


109* 


1 




1 


28 


47 


1 


43 


59 


1 


53 


67 1 




1 


110 


1 




1 


21 


34 


1 


38 


57 


1 


50 


59 1 




1 


111 


1 




1 


38 


45 


1 


77 


78 


1 


84 


86 1 




1 

1 


112 


1 




1 


35 


45 


1 


57 


60 


1 


58 


66 1 




1 

1 


113 


1 




1 


23 


29 


1 


57 


63 


1 


65 


76 1 




1 

1 


114 


1 




1 


27 


27 


1 


48 


59 


1 


55 


71 1 




1 

1 


115 


1 




1 


23 


45 


1 


20 


39 


1 


34 


40 1 




1 

1 


116 


1 




1 


22 


38 


1 


51 


47 


1 


67 


70 1 




1 

1 


117 


1 




1 


42 


38 


1 


75 


78 


1 


79 


84 1 




1 

1 


118 


1 




1 


34 


43 


1 


71 


79 


1 


79 


86 1 




1 

1 


119 


1 

1 




1 


31 


45 


1 


73 


74 


1 


74 


83 1 


1 


1 

1 


120 


1 




1 


29 


38 


1 


63 


57 


1 


61 


72 1 
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Table 3.1.5 (continued) 

Percent of Children Responding Correctly to Test Iteas 
by Grade and Year with Special Itens Noted by Asterisk 



1 Sub test 


1 

1 

1 . 


Item 


1 

1 

— 1 » 


Grade 1 
1986 1987 


1 

1 


Grade 2 
1986 1987 


1 

1 

1 


Grade 3 
1986 1987 


Grade 4 
1986 1987 




1 7 


1 

1 


121 


■ 1 
1 




1 

1 




“I" 

1 


37 


68 


58 


65 






1 


122 


1 




1 




1 


50 


73 


67 


73 






1 


123* 


1 




1 




1 


56 


66 


64 


80 






1 


124* 


1 




1 




1 


26 


54 


44 


62 






1 


125* 


1 




1 




1 


45 


70 


58 


66 






1 


126 


1 




1 




1 


43 


53 


53 


61 






1 


127 


1 




1 




1 


87 


89 


86 


81 






1 


128 


1 




1 




1 


64 


81 


71 


70 






1 


129 


1 




1 




1 


68 


66 


71 


82 






1 


130 


1 




1 




1 


36 


44 


44 


46 






1 


131 


I 




1 




1 


41 


50 


49 


53 






1 


132 


1 




1 




1 


21 


32 


23 


28 






1 


133 


1 




1 




1 


29 


33 


32 


23 






1 


134 


1 




1 




1 


58 


66 


59 


70 






1 


135 


1 




1 




1 


44 


52 


53 


59 






1 


136 


1 




1 




1 


43 


44 


37 


55 






1 


137 


1 




1 




1 


73 


79 


79 


87 






1 


138 


1 




1 




1 


27 


41 


41 


52 






1 


139 


1 




1 




1 


62 


67 


74 


78 






1 

t 


140 


I 

t 




1 

t 




1 


40 


48 


57 


67 




I 8 


1 

1 


141 


1 

1 




1 

1 




1 

1 






63 


64 






1 


142 


1 




1 




1 






49 


51 






1 


143 


1 




1 




1 






25 


46 






1 


144 


1 




1 




1 






55 


66 






1 


145 


I 




1 




1 






58 


69 






1 


146 


1 




1 




1 






36 


37 






1 


147 


1 




1 




1 






31 


46 






1 


148 


1 




1 




1 






23 


21 






1 


149 


1 




1 




1 






58 


63 






1 


150* 


I 




1 




1 






29 


50 






I 


151 


I 




1 




1 






68 


75 






1 


152 


1 




1 




1 






29 


’ 36 






1 


153 


1 




1 




1 






50 


62 






1 


154 


1 




1 




1 






35 


36 






I 


155 


1 




1 




1 






50 


30 






1 


156 


1 




1 




1 






26 


29 






1 


157 


1 




1 




1 






56 


45 






1 


158 


1 




1 




1 






45 


40 






1 


159 


1 




1 




1 






45 


52 






1 


160 


1 




1 




1 






34 


35 
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be retained because the word "Haafila” is a particularly good example 
of a Modern Standard Arabic word that children do not use in Jordan. 
Because of the widespread use of English in Jordan, use of the English 
word for bus had become common. Therefore, children tend not to learn 
the MSA word "Haafila.” On the other hand, in Morocco and Tunisia, 
the linguistic influence is French. But, the French pronunciation of 
bus is not commonly used in the vernacular because the French ”u” 
sound is not present in the Arabic language. Therefore, Dr. Ibrahim 
urged the retention of the item to check the hypothesis that, in 1986, 
children in Morocco and Tunisia would recognize the word ”Haafila** 
more readily than children in Jordan. He suggested that performance 
on that item would improve markedly if AL MANAAHIL was successful. 

Based on the 1986 data in Morocco and Tunisia, and the 1987 data 
in Jordan, both hypotheses were verified. In December 1986, in 
Jordan, 13% of first graders, 10% of second graders, 15% of third 
graders, and 13% of fourth graders responded correctly to Item 49. 
Corresponding "percent correct" response rates in Morocco were 10, 

58, 72, and 71 and in Tunisia 22, 62, 73, and 91 respectively. We did 
not retest in Morocco and Tunisia in 1987 because the television 
series was not broadcast in 1987. In December 1987, in Jordan, in the 
same schools that participated in the December 1986 testing, the 
corresponding "percent correct" response rates were 14, 27, 32, and 56 
in Grades 1, 2, 3, and 4 respectively. These results support the case 
that the increased performance of the children was due to AL MANAAHIL. 

In order to judge the children's performance on the special 
items, it was necessary to identify reasonable estimates of what their 
performance would have been in the absence of AL MANAAHIL. First, 
we attempted to compare the children's "percent correct" response 
rates on one or more items to the average response rate for the 
subtest containing the item or items. This approach was not useful 
because differences in percents are difficult to compare at different 
points on the scale. 
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As an alternative, we compared items on the basis of whether the 
"percent correct" response rates increased between 1986 and 1987. If 
the reading skills of the children in 1987 were equal to the reading 
skills of the children in 1986, we would expect approximately half the 
items to show increases. If the reading skills of the children in 
1987 were better than the reading skills of the children in 1986, we 
would expect the percentage of increases to be greater than 50%. The 
observed values, as the following data indicate, were 73%, 84%, 77%, 
and 88% for Grades 1, 2, 3, and 4 respectively. 

Those results, obtained from the same data as results already 
presented in this chapter, are not surprising. We had already found 
that the children in 1987 performed significantly better than those in 
1986. If the positive change was due to AL MANAAHIL, and if the 
special items we have selected are more closely related to the goals 
and objectives than other items in the Arabic Reading Test, then we 
would expect the improvement on the special items to exceed the 
overall improvement on all items. On the special items, the observed 
values for the special items alone were 95%, 96%, 73%, and 88%. In 
Grades 1, 2, and 4, the performance of the children on the special 
items exceeded the average performance using the total data. The 
results reported in Tables 3.1.1 and 3.1.2 were least significant 
in Grade 3, especially on the Core Test. 

Although these results do not prove that the positive effects 
found in this study were due to AL MANAAHIL, they provide further 
supporting evidence for that conclusion. 

Results based on adult judgments . Approximately 500 teachers , 
parents, and other adults responded to questions about the impact of 
AL MANAAHIL on Arab children. All agreed, by and large, that AL 
MANAAHIL had a positive impact on Arab children - on their learning as 
well as their enjoyment. Even those respondents who did not 
themselves like the series thought that the children liked it and that 
it had a positive impact on the children. 
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The results are given in full in the Section 3.4 and 3.5. 
Results relevant to the children's reading skills are given here. 



A. TeacheiL judgments of impact on reading 



NUMBER PERCENT 



Q8. Effect of AL MANAAHIL on 
children's reading skills. 



Very Positive 
Positive 
Have no opinion 
Negative 
Very Negative 



24 17% 

74 53% 

37 26% 

4 3% 

2 1 % 



(2) Judgments of parents and other adulta 



Q8. Effect of AL MANAAHIL on 
reading skills of children 
in Jordan. 



Very positive 



Positive 
Not sure 
Negative 



Very negative 



31 19% 

90 55% 

34 21% 

8 5% 

1 1 % 



These results support the conclusion reached in the preceding section, 
namely, that AL MANAAHIL had a positive impact on the reading skills 
of children in Jordan. 

Summary . Results on the Grade Level Tests, the Core Test, and 
the 8 Subtests in the Arabic Reading Test Battery indicate that 
children's reading skills improved between December 1986 and December 
1987. They improved on reading tests developed especially to test the 
goals and objectives of the AL MANAAHIL television series. 

Because the increased test scores may have been due to other 
improvements taking place in the educational system in Jordan, student 
achievement on a special set of items directly related to very 
explicit items in the goals and objectives was examined. Performance 
on the special items supported the overall conclusion that AL MANAAHIL 
was the cause of the improvement in achievement. 

Finally, teachers, parents, and other adults, when asked, 
supported the conclusion that AL MANAAHIL had a positive impact on the 
children's reading skills. 
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3.2. Impact on Student Behavior and Attitudes 

Effects of AL MANAAHIL on the behavior and attitudes of children 
were inferred from the children's responses to questions asked when 
they were tested. Conclusions drawn from the children's responses 
were reinforced by information provided by teachers, parents, and 
other adults. 

In the December 1987 testing, the children were asked to respond 
yes or no to five questions. Some questions were presented in the 
past tense because AL MANAAHIL was not on the air at the time of 
testing. The questions and the percentages of those responding "yes” 
in each grade are given below. 

Question PERCENT ANSWERING YES 





GRADE 1 
(N-199) 


GRADE 2 
(N-570) 


GRADE 3 
(N-232) 


GRADE 4 
(N-288) 


1. Do you have a television set? 


98.0% 


97.5% 


98.3% 


97.9% 


2 . Do you know about the program 
AL MANAAHIL? 


86.9% 


97.0% 


97.8% 


98.6% 


3. Did you see any shows when 
AL MANAAHIL was on? 


87.9% 


96.7% 


97.0% 


97.6% 


4. Did YOU watch the AL MANAAHIL 
television series regularly? 


80.4% 


87.7% 


89.2% 


76.4% 


5. Did vou like the AL MANAAHIL 
programs when you saw them? 


87.9% 


94.6% 


97.0% 


95.5% 



The children's responses appear to be credible. Members of the 
advisory committee had anticipated that virtually all children have 
access to television. The results are consistent across the four 
grades. And, the fact that the responses are least positive on 
question 4 increases our confidence that the children understood the 
questions. There were virtually no missing data. 
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These data indicate that the vast majority of children watched 
the shows and liked them. They are consistent with data collected 
from teachers, parents, and other adults who responded to survey 
questionnaires in December 1987 . 

Two surveys were conducted, a Teacher Survey and a General Survey 
intended for parents and other adults contacted through the University 
of Jordan. Copies of the questionnaires in English are given in 
Appendix D. The questionnaires were translated by Dr. Abdallah 
Kaylani, Dean, Faculty of Education, University of Jordan. They were 
distributed to teachers whose children participated in the testing 
program, and to teachers in graduate programs in the University of 
Jordan and the Amman Technical Institute. Full discussions of the 
responses are given in Sections 3.4 and 3.5. In this section, we 
summarize those results relevant to students. 

In both surveys, respondents were asked to give their opinions of 
the overall impact of AL MANAAHIL on the children, its effect on the 
children's understanding and appreciation of Arabic culture and 
tradition, and its effect on the children's attitudes toward the show. 
Parents were asked if they watched the shows with their children. 



TEACHERS ONLY 




NUMBER 


PERCENT 


7 Overall effect of AL MANAAHIL 


Very Positive 


32 


23% 


on children. 


Positive 


71 


51% 




Not Sure 


31 


22% 




Negative 


4 


3% 




Very negative 


2 


1% 


9. Effect on children's understanding 


Very positive 


24 


17% 


and appreciation of Arabic 


Positive 


65 


46% 


culture and tradition. 


Not sure 


48 


34% 




Negative 


3 


2% 




Very Negative 


1 


1% 
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NUMBER 


mOML 


11. Feelings 


of children 


Like it 


very much 


69 


51% 


about AL 


MANAAHIL. 


Like it 


somewhat 


49 


36% 






Neither 


like nor dislike 


16 


12% 






Dislike 


it 


1 


1% 






Dislike 


it very much 


0 


0% 



PARENTS AND OTHER ADULTS 




NUMBER 


PERCENT 


4. Do vou watch AL MANAAHIL 


Yes 


99 


62% 


with your children? 


No 


60 


38% 



7 . Overall effect of 


Very positive 


29 


18% 


AL MANAAHIL on children. 


Positive 


83 


50% 




Not sure 


42 


25% 




Negative 


11 


7% 




Very negati" 


1 


1% 



9. Effect on children's understanding 


Very positive 


22 


13% 


and appreciation of Arabic 


Positive 


82 


50% 


culture and tradition. 


Not sure 


43 


26% 




Negative 


15 


9% 




Very negative 


2 


1% 



11. Feelings 


of children 


Like it very much 


80 


49% 


about AL 


MANAAHIL. 


Like it 


55 


34% 






Neutral 


23 


14% 






Dislike it 


1 


1% 






Dislike it very much 


3 


2% 



These results support the conclusions that the children watched the AL 
MANAAHIL series, that they learned from it, that they liked the 
programs, and that AL MANAAHIL had an overall positive impact on the 
behavior and attitudes of children in Jordan. 
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3.3. Impact on Adults in Literacy Programs 

USAID expressed an interest in information about the effect of AL 
MANAAHIL on adults in need of special help in developing literacy 
skills. Through contacts at the University of Jordan, we were able to 
gather two small sets of data (See Tables 2.4.5 and 2.4.6). 

In general, test scores of the 1987 group were lower than those 
of the 1986 group. Even on special items, because of the small 
numbers, it was not possible to replicate the approach used in the 
investigation of the children's data. 

However, in 1987, the adults were asked the same five questions 
as the children. We considered their responses interesting and 
interpretable. In addition, although the numbers were small, there 
were significant differences in achievement between those who watched 
AL MANAAHIL and those who did not. We present the response data and 
some analysis of the test data, meanwhile cautioning the reader that 
these data can not be interpreted unambiguously. 

QUESTION NUMBER AND PERCENT ANSWERING YES 





NUMBER 


PERCENT 




(N-86) 


(100%) 


Do you have a television set? 


83 


97% 


Do you know about the program 
AL MANAAHIL? 


62 


72% 


Did you see any shows when 
AL MANAAHIL was on? 


58 


67% 


Did vou watch the AL MANAAHIL 
television series regularly? 


33 


38% 


Did vou like the AL MANAAHIL 
programs when you saw them? 


54 


63% 
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Note that only 58 (67%) reported seeing at least one of the AL 
MANAAHIL programs. Therefore, the 54 (63%) who reported liking the 
series represent 93% of those v/ho reported seeing some of the shows. 

The data provided to ETS gave grade levels for each adult. There 
were 22, 58, and 6 adults identified as being at Grade 1, Grade 3, and 
Grade 4 levels respectively. It is interesting to examine the data by 
grade level. 



Adults Grade Level Test Core Test 







N 


Mean 


SD 


N 


Mean 


SD 


Grade 


1 


22 


47.2 


16.7 


22 


22.1 


8.9 


Grade 


3 


58 


62.9 


15.1 


58 


28.2 


6.6 


Grade 


4 


6 


95.5 


3.2 


6 


25.7 


2.4 


Total 




86 


_ _ _ _ 


. . » 


86 


26.4 


7.5 



Because the Grade Level Tests are unique to the grade, it is not 
possible to interpret the data on those tests. In other words, the 
fact that mean scores on Grade Level tests increase as you proceed 
down the column is meaningless. Therefore, no average is given for 
the total 86 adults. On the ether hand, the Core Test data are quite 
interesting because all adults took the same Core Test. The mean 
score for adults listed as being at the Grade 1 level appears 
reasonable in that it is less than those listed as functioning at 
higher levels. However, those listed as functioning at a Grade 3 
level performed better on the average than those listed as Grade 4. 

In general, adults listed as functioning at a Grade 1 level performed 
much better than Grade 1 children in the evaluation. These same kinds 
of problems and issues occur in the United States when grade level 
terminology are used for adults. 
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To provide information on the impact of AL MANAAHIL on the 
reading skills of the adults, we compared the scores of those who 
indicated that they watched regularly (N-33) with those who did not 
watch any programs at all (N"28) . Of course, any interpretation is 
confounded by the fact that achievement may be either negatively or 
positively correlated with viewing. Therefore, results cannot be 
interpreted apart from all other results in the study. If positive, 
we can say they point in the same direction as other results. The 
results are summarized below. Because the adults were identified as 
being at the Grade 1, 2, 3, and 4 level, they took different groups 
of subtests. We examined the results using the Core Test results. 

The average score on the Core Test for the 33 adults who watched 
AL MANAAHIL regularly was 29.6 with a standard deviation of 4.7. The 
average score of 28 adults who reported viewing no programs at all was 
24.4 with a standard deviation of 8.3. The difference of 5.2 is 
significant (p < .01) for these samples. This result supports the 
overall conclusion of a positive impact of AL MANAAHIL on those who 



viewed the shows . 
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3 .4 Impact on Teachers 

USAID expressed its interest in information about the effects of 
AL MANAAHIL on teachers. It was anticipated that teachers might adopt 
and/or adapt some of the formats and approaches used in the series. 

In addition, it was anticipated that use of the MSA would provide a 
motivation for teachers to continue incorporating MSA in the earliest 
years of the children's schooling. 

Teachers whose children were tested, and other teachers in 
programs at the University of Jordan and the Amman Technical 
Institute, were asked to respond to a questionnaire. Approximately 
200 questionnaires were distributed. In all, 144 teachers responded 
during the month of December 1987. Responses are summarized below. 
Percentages are based only on those who responded to a given question. 
This is a common way of reporting these kinds of data. However, in 
some instances, the results are misleading. For example, the 
responses to question 13 are based on only 68 teachers who responded 
to that question. Thus, the distribution gives the results for the 
responding sample. An implication of this approach is that others 
would have given similar responses if they were forced to respond. 

The approach depends on the use that will be made of the results . 

NUMBER PERCENT 



Grades taught by 


Grade 1 


26 


19% 


responding teachers. 


Grade 2 


21 


16% 




Grade 3 


27 


20% 




Grade 4 


48 


36% 




Grade 5 


13 


10% 



Number 


of 


children taught. 


(Not reported) 






Number 


of 


years teaching . 


First year 


10 


7% 








1 - 5 


23 


16% 








6 - 9 


32 


23% 








10 or more 


76 


54% 
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NUMBER 


PERCENT 


4. Are you "familiar" with the 


Yes 


100 


75% 


TV oroeram AL MAAAHIL? 


No 


33 


25% 



5. Number of half-hour programs 


Haven't seen any 


23 


16% 


of AL MANAAHIL seen. 


1 - 2 


36 


26% 




3 - 9 


61 


44% 




10 or more 


20 


14% 



6 . Do 


you like the TV series 


Like it very much 


22 


16% 


AL 


MANAAHIL? 


Like it 


69 


49% 






Not sure 


18 


13% 






Dislike it 


25 


18% 






Dislike it very much 


8 


6% 



7. Overall effect of AL MANAAHIL 


Very Positive 


32 


23% 


on children. 


Positive 


71 


51% 




Not Sure 


31 


22% 




Negative 


4 


3% 




Very negative 


2 


1% 



8. Effect of AL MANAAHIL on 




Very Positive 


24 


17% 


children ' s reading skills . 




Positive 


74 


53% 






Have no opinion 


37 


26% 






Negative 


4 


3% 






Very Negative 


2 


1% 



9. Effect on children's understanding 


Very positive 


24 


17% 


and appreciation of Arabic 


Positive 


65 


46% 


culture and tradition. 


Not sure 


48 


34% 




Negative 


3 


2% 




Very Negative 


1 


1% 



10. Type of feedback from parents. 


Very Positive 


16 


12% 




Positive 


61 


44% 




No feedback 


48 


35% 




Negative 


11 


8% 




Very negative 


3 


2% 
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NUMBER PERCENT 















11 . Feelings 


of children 


Like it 


very much 


69 


51% 


about AL 


MANAAHIL. 


Like it 


somewhat 


49 


36% 






Neither 


like nor dislike 


16 


12% 






Dislike 


it 


1 


1% 






Dislike 


it very much 


0 


0% 



12. Effect of AL MANAAHIL on 


Very positive 


12 


9% 


your teaching. 


Positive 


62 


45% 




No effect 


55 


40% 




Negative 


7 


5% 




Very negative 


1 


1% 



13. Examples of ways that AL 


MANAAHIL has been helpful. 






(68 respondents) 


Language 


18 


27% 




Information, conversation 


34 


50% 




Reading and writing 


16 


24% 


14. Strengths and weaknesses 


of AL MANAAHIL. 







A. STRENGTHS: 


Language 


23 


33% 


(69 respondents) 


Inforaation 


18 


26% 




Variety 


6 


9% 




Methods 


17 


25% 




Reading and writing 


5 


7% 



B. WEAKNESSES: 


Production, direction, acting 


25 


44% 


(57 respondents ) 


Non-presence of children 
Use of parts- to-whole approach 


18 


32% 




in language teaching 


12 


21% 




Lack of emphasis on dictation 


2 


4% 



In general, the results are positive. The majority of teachers 
(65%) indicated that they liked the series or liked it very much. 

Most (74%) noted that the series had a positive or very positive 
impact on the children. When asked about AL MANAAHIL's effect on 
their teaching, a majority (54%) of teachers indicated that AL 
MANAAHIL had a positive or very positive effect. 
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3,5. Impact on Parents and Other Adults 



A general questionnaire about AL MANAAHIL was distributed to 
approximately 200 faculty members and friends through the Dean's 
office in the Faculty of Education at the University of Jordan. 
Although this is a narrow sample, the results are consistent with 
other results in the study. The data have not been reviewed further 
to resolve inconsistencies due to alternatives provided in the listing 
of descriptive characteristics. Nor have simple categories of 
strengths and weaknesses been examined in detail. In all, 173 adults 
responded to the questionnaire. 



NUMBER PERCENT 



1. Description of 


Parent 


107 


64% 


respondents . 


Primary School Teacher 


4 


3% 




Preparatory School Teacher 


2 


1% 




Secondary School Teacher 


9 


5% 




University Staff Member 


4 


2% 




Graduate Student 


21 


13% 




Other 


21 


13% 



2. 


Do you have any young 


Yes 




115 


69% 




children - ages 5 to 9? 


No 




51 


31% 


3. 


Are you familiar with the 


Yes 




124 


74% 




TV program AL MANAAHIL? 


No 




44 


26% 


4. 


Do vou watch AL MANAAHIL 


Yes 




99 


62% 




with your children? 


No 




60 


38% 


5. 


How many half-hour programs 


Haven ' t seen any 


15 


9% 




of AL MANAAHIL have you seen? 


1 - 


2 


52 


31% 






3 - 


9 


76 


45% 






10 


or more 


25 


15% 



6 . Do 


you like the 


Like it very much 


28 


17% 


TV 


series AL MANAAHIL? 


Like it 


74 


44% 






Not sure 


17 


10% 






(Don't care) 


32 


19% 






Dislike it 


16 


10% 
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NUMBER PERCENT 



7. Overall effect of 


Very positive 


29 


18% 


AL MANAAHIL on children. 


Positive 


83 


50% 




Not sure 


42 


25% 




Negative 


11 


7% 




Very negative 


1 


1% 



8. Effect of AL MANAAHIL on 


Very positive 


31 


19% 


reading skills of children 


Positive 


90 


55% 


in Jordan. 


Not sure 


34 


21% 




Negative 


8 


5% 




Very negative 


1 


1% 



9. Effect on children's understanding 


Very positive 


22 


13% 


and appreciation of Arabic 


Positive 


82 


50% 


culture and tradition. 


Not sure 


43 


26% 




Negative 


15 


9% 




Very negative 


2 


1% 



10. Type of feedback from 


Very positive 


19 


12% 


associates about AL MANAAHIL. 


Positive 


56 


34% 




Not sure 


51 


31% 




Negative 


31 


19% 




Very negative 


7 


4% 



11. Feelings of children 


Like it very much 


80 


49% 


about AL MANAAHIL. 


Like it 


55 


34% 




Neutral 


23 


14% 




Dislike it 


1 


1% 




Dislike it very much 


3 


2% 



12. Strengths and weaknesses 


of AL MANAAHIL. 






STRENGTHS : 


Language 


55 


50% 


(110 respondents) 


Reading & writing 


32 


29% 




Information 


23 


21% 



WEAKNESSES: 


Acting, direction, 


52 


52% 


(100 respondents) 


production, style , method 








Non-presence of children 


13 


13% 




Lack of motivation/excitement 


35 


35% 



artificiality 
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These results also support the general conclusion of an overall 
positive impact of AL MANAAHIL. However, note that the data are not 
consistent across responses. We have decided to present them as 
received because some problems may have been due to translations and 
misunderstanding. For example, in Question 3, respondents were meant 
to indicate "familiarity" with the series. The Arabic question 
probably has an additional meaning. Otherwise, how can we interpret 
Question 3 (44 respondents are listed as giving "no" responses) and 
Question 5 (only 15 respondents saw no shows at all) . It is more 
likely that 153 of the respondents, or 91%, are familiar with the AL 
MANAAHIL series. Rather than not report these informative data, we 
have decided to report them with the inconsistencies present. In 
general, the estimate of positive effects is a conservative one. 

Of those who responded to Question 6, the majority (61%) liked 
the series or liked it very much. Again, this is a conservative 
estimate. Notes provided with the data indicate that the question was 
rephrased somewhat. 

Regardless of the problems in interpreting all of the responses, 
some responses are very clear. On Questions 7 and 8, the majority of 
respondents agree that the impact of AL MANAAHIL was positive or very 
positive on the children in general and on their reading skills. 

There are small numbers of negative responses on most responses. This 
result gives credibility to the overall data. More details on this 
information would require further research beyond the modest surveys 
attempted in this study. 
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CHAPTER 4 

SUMMARY AND CONCLUSIONS 



This complex project involved a nvunber of different groups and 
organizations with a variety of goals and objectives. In this summary 
chapter, we conclude by mentioning the principal goals achieved by 
each. 



For the Arab nations, and Jordan in particular, there is now 
available a professional television program valid for the purposes 
intended - to help children learn Modern Standard Arabic. In Jordan, 
there exist a talented group of actors and actresses ready to use 
MSA in additional television programs for children, television 
producers with expertise in using new production formats and 
techniques, a prototype children's television series as a standard 
to surpass - 65 half-hour shows which are entertaining and 
educationally effective. In AL MANAAHIL, all Arab countries, and 
other countries with Arab populations, have a children's series that 
is clearly Pan- Arab. 

Children's Television Workshop can be satisfied with having 
persevered through many difficult technical issues, complex production 
schedules, equipment transfers from the United States to Jordan, the 
addition of new staff when needed, logistics of housing and travel, 
health issues, and maintenance of camaraderie and morale. They 
fostered professionalism, collaboration, good humor, and respect among 
those who participated in the creation and production of AL MANAAHIL. 

The United States Agency for International Development has 
succeeded in funding and directing a mass media project with valid 
signs of success and good indications that that success will spread 
farther afield in the future. 
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Educational Testing Service gained experience in working 
collaboratively with educational systems in Arab nations. Conducting 
research which required detailed test construction and production, 
large scale data collection, transferring of large amounts of data 
from Arab countries to the United States, shipping tests locally 
between Arab countries, obtaining local translations of materials, 
negotiating contracts with colleagues in research, frequent transfers 
of funds abroad, and working with alumni of the ETS International 
Summer Educational programs were rewarding activities. Communication 
between Jordan, Morocco, and Tunisia was fostered. And, finally, 
many new friendships were made. 

Overall, the AL MANAAHIL project appears to have accomplished its 
goals. The television series was generally liked by all groups who 
viewed the programs. Children learned. Adults learned. Teachers 
used strategies form the shows in their teaching. Many parents 
watched AL MANAAHIL with their children. There was evidence in the 
evaluation to support all these conclusions. 
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APPENDIX A 



Goals and Objectives of AL MANAAHIL 
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III, SPECIFIC GOALS AND LAHGOAGE COHTENT 



A. Phonology (Soimdsy 

1. Correct pronunciation of all sounds in standard Arabic. Special emphasis 
will be given to problems arising from underdiscrimination between certain 
sounds in some social and regional dialects spoken in the Arab region, and 
in particular: 

i. Correct pronunciation of dhaal and distinguishing it from deal and 
zaay . 

ii. Correct pronunciation of thaa^ and distinguishing it from taa ^ and 



iii. Correct pronunciation of DHaa' and distinguishing it from Daad and 
zaay muf akhkhama . 

iv. Correct pronunciation of Daad and distinguishing it from DHaj^. 

2. Correct aural discrimination of individual Arabic sounds. This follows 
from and is closely connected with the preceding item. For example, a 
speaker who does not have DHaa' or thaa' in his/her should be able to hear 
these sounds when they occur in standard Arabic and distinguish them from 
Daad^ or zaay muf akhkhama and si in or taa^ respectively. 

3. Recognition and production of correct or suitable intonation patterns 
used in association with specific patterns of written language. Thus, 
the intonation pattern used with a question is different from that used 
with a statement, a command, or an exclamation, a fact which is indicated 
in writing by the use of different punctuation marks for each of these 
types of utterance. Intonation can also vary within the same t 3 rpe of 
utterance as when different intonation patterns are used to distinguish a 
complete utterance (indicated by a full stop in writing) from an 
incomplete one (indicated by a comma, dash, etc.). 

4. Correct and smooth pronunciation of syllables, words, and sentences in 
general (i.e., the articulation of sounds in connected speech). More 
specifically: 

i. Correct pronunciation of the definite article lal^ in relation to 
**sun” and “moon" letters. 

ii. Correct pronunciation of letters and symbols with more than one 
pronunciation as in: 



siin. 



*alif as a vowel and as a carrier of the hainza . 



waaw and yaa* as vowels and consonants. 
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the taa* marbuuTa as a taa* and a haa* . and 
elision associated with the Hamzatti 1-waSl . 



5. The use and appreciation of spoken language as a source of joy and 
amusement (word play, songs, rhymes, etc.)- 



B. Orthography (Writing ) 



1. Correct visual discrimination of letters of the alphabet and their names, 
with special attention to: 

i. Recognizing different shapes of the same letter (including 
alif maqSuura and *alif mamduuda ) . 

ii. Correct discrimination of letters with identical or similar shapes 
but different dotting. 



2. Recognizing diacritical and short vowel signs and their contribution to 
pronunciation. These include: 

i. Short vowel (vocalization) signs ( fat -Ha . namma . and kasra ) . 

ii. Diacritics ( shadda . sukuun . madda . hamzatn 1-wasl ) . 

iii. Nunnation signs ( tanwiln fat -Ha . Damma and kasra ) . 



3. Dealing with some problems which arise from the lack of correspondence 

between spelling and pronunciation. These problems include: 

i. Sounds represented different letters or letter shapes 
or symbols (e.g., * alif . haa* . hanza . taa' . and nuun which 
is represented by a letter and three nunnation signs). 

ii. Sounds which are not represented in writing such as the 
long vowel in haadhaa . laakin . and Taahaa . 

iii. Letters and symbols which are written but not pronounced 
(e.g. , *alifu 1-1 amaa ' a . the unpronounced waaw in 9amr . 
and hamzatul l-waS1 1 . 

iv. Recognition of letter combinations (digraphs), 

V. Letters which stand for more than one sound (e.g., *alif . 
waaw . and vaa* ) . 
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4. Correct letter formation and spelling in writing, including correct 
positioning on the line and correct hand movement, and the ability to 
distinguish which letters connect to others and which do not. 



5. The use and significance or function of punctuation marks in writing. 

6. Recognition of differences between numerals used in the Maghrib 
(Western) and Mashriq (Eastern) Arab countries. 



7. Learning the Arabic alphabetic order. 



C. Morphology (Paradi gms and Patterns) 



1. Associating some grammatical endings (inflections) with certain 
grammatical devices (e.g., jarr marked by i, -in, etc. with 
prepositions, j azm in verbs with lam . fat* Ha with 3rd person singular 
verbs in the past, etc.) 



2. Attending to some special issues in morphology which have a bearing on 
reading such as : 

i. hamzatu 1-waSl in some verb forms (e.g. , staobala) and their 
derivatives and moods (imperative) . 

ii. Sound and broken plurals. 

iii. Dual forms. 

iv. Passive and active verb forms (mainly form I verbs). 



3 . Presenting suitable and adequate material on the derivational 

patterning of Arabic including: 

i. Verb forms (I - X) (i.e., the basic and augmented forms). 

ii. Nominal and adjectival forms derived from some of these 
verb forms. 

iii. Derivational analysis of related words as in the different 
verb forms (I, II, III, IV, etc.), words belonging to 
different parts of speech derived from the same root (£fi 
write , book , writer , office , library . IgtVgC, etc.). 
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4. Presenting suitable and adequate material concerning the structural 

patterning and analysis of Arabic words including: 

i. Number and gender in nouns and adjectives (singular, dual 
and plural; masculine and feminine). 

ii. Person, gender, and number in verbs. 

iii. Person, gender, and number in pronouns. 

iv. Agreement patterns in number and gender (masculine vs feminine 
patterns) and definiteness (definite noun + definite adjective 
or indefinite noun + indefinite adjective). 



5. 



Vowel mutations in some verbs and other parts of speech related to them 
as in: 

o ahaf aa : va ghfuu : ghafawtu : ghafwa : 
ramaa : yarmil : ramaytu; ramva : 
naama : vnaamu ! nimtu : nawma : 



Or as in o WaSala : YaSilu : Waoafa; Yaaifu : 

WaDh9a, YaPha9u . 



6. Patterns of adjectival comparison (e.g. , kabiir : * akbar : kubraa ) . 

D. Syntax 

1. Word order and its importance to meaning and as a factor in morphology 
and grammar. 



2. Relation of grammar to meaning as in: 

i. The difference between active and passive constructions. 

ii. Differences in number, gender, and definiteness. 

iii. The relation between tense, mood and time in verbs. 

Iv. Nominal and adjectival cases. 

V. Inflections associated with various verb moods. 

vi. Different types of utterances and their corresponding meanings 
(statements, questions, commands, affirmative and negative 
sentences , etc . ) . 




3. Patterns of questions and answers appropriate to each pattern (Who? 
How? What? When? Yes/No questions, etc.). 
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4. Basic structural sentence patterns, including the following three major 
types and some of their sub- types: 

i. Structurally simple patterns (i*e*, those consisting of a subject 
and predicate) and some of their variations: 

a. Nominal sentences: 

1. With the subject as a singular noun; demonstrative, personal 
pronoun, etc . . 

2. With the subject as a dual form of the preceding elements. 

3. With the subject as a plural (masculine and feminine 'sound' 
as well as 'broken') form of the elements in (1) above. 

4. With the predicate as a singular, dual, and plural form 
(as detailed for the subject in 1-3 above). 

5. With the predicate as a prepositional or adverbial phrase. 

b. Verbal sentences: 

1. With the verb element in first or second position. 

2. With the predicate as an intransitive verb in the 
past or present, simple or augmented, alone or 
followed by another element (e.g. , an adverb). 

3. With the predicate as a transitive verb in the 
past or present, simple or augmented, 

4. Active sentences with the subject unstated. 

5. Passive sentences. 

c. Nominal and verbal sentences used with some 'auxiliary' verbs 
(e.g., kaana and its 'sisters') or particles (e.g., 'inna 
and its 'sisters'). 

ii. Structurally non- simple sentences which can be procs. sed by 
members of the target group including: 

a. Non-simple sentences with co-ordinate (conjunctive) 
elements only. 

b. Non-simple sentences with subordinate (embedded) 

sentences only in which the subordinator is a relative 
pronoun or a particle ( ' in 'if,' * ilUlft 'verily,' 

' Idhaa 'if, ' etc.) . 

c. Non- simple sentences with subordinate and co-ordinate 
sentences at the same time. 
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iii. Basic conununicative sentence patterns, including: 
a* Affirmative statements. 

b. Negative statements. 

c. Affirmative questions. 

d. Negative questions . 

e. Affirmative commands or requests. 

f. Negative commands or requests. 

g. Exclamations. 

h. Conditional sentences. 

i. Vocative sentences. 

j. Exceptive sentences. 

E. Lexis (Vocabulary) 

1. Teaching basic sets of sight reading vocabulary including the following 
sets or parts thereof: 

i. Function words (prepositions, pronouns, demonstratives, 
interrogatives , adverbs , ^yes* /^no * particles , markers of 
discourse , etc . ) . 

ii. Expressions and formulas which recur in the children's 
environment. 

iii. High-frequency words in the children's environment. 

2. Expanding the children's MSA vocabulary and reinforcing their existing 
stock of such words in addition to developing their awareness of the need 
for precise vocabulary selection as a means to achieving accuracy of 
expression (e.g., choosing the right word from a group of semantically 
related words to denote the sound of a specific animal; choosing the right 
word to denote a certain baby, animal, or bird; choosing the right word to 
describe a mode of locomotion - 'walk,' 'jog,' 'run,' etc.). 

3. Idioms and other types of formulaic language which help the children 
acquire sociolinguistic competence and the appropriateness of language to 
the following factors, among others: 

i. Time of day (e.g., good morning, good evening). 
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ii. Situation (e.g., saying ’thank you' to a person who helps 
speaker) . 

iii. Linguistic input (e.g., a greeting from another person must not 

be met with silence from the addressee but with a suitable exchange 
of greetings. 

iv. Occasion (e.g., using language appropriate to such occasions as a 
birthday, Christmas, etc.). 

V. Conventionalized associations between linguistic and non-linguistic 

matters (e.g., breakfast is associated with motming, lunci with noon,, 
and dinner with evening) . 



4. Utilization of the notion of 'word family' on various linguistic levels 
including: 

i. Paradigms and conjugations. 

ii. Derivational patterns based on the same root. 

iii. Semantically related words and concepts (e.g., kinship terms used in 
agriculture, cooking, health, time, quantity and amount, 
comparison and degree, location and direction, cause and 

result, purpose and reason, etc.). 

iv. Synonyms and antonyms. 

V. Phonologically related words (minimal pairs, rh 3 nning words, 
words used for progressive shifting, etc.). 

vi. Grammatical and structural similarity (parts of speech). 

vii. Orthographic similarity (as in words which differ with regard 
to dotting or with regard to vocalization) . 



5. Lexical variation in MSA as in the case of different words used in naming 
some fruits and vegetables (e.g. peaches, plums, potatoes, tomatoes), 
milk products (e.g., laban . Halib . yoghurt), units of currency (e.g., 
diinaar . dirham , rivaal . liira . j ineeh) . and others. 



6. Using dictionaries and other reference material (e.g., children's 
encyclopedias, telephone directories, etc.). 



7. Teaching some basic meta- linguistic terms and concepts which are 
essential in the presentation of program content. Examples of such 
concepts are: word, sentence, names of letters of the alphabet and the 
diacritics, punctuation marks, questions, and others. 
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F. Coaprehens ion 



Without teaching comprehension as an ultimate goal, no reading program 
would be worth the name. However, because of special considerations, 
which include such factors as the limitations of television for 
presenting extended texts and the age group which is the target of the 
AL MANAAHIL series, we must necessarily satisfy ourselves with the 
teaching of the most basic and elementary reading skills and 
strategies which will hopefully provide the target population with the 
sound and solid foundations needed for becoming effective and mature 
readers in the future. But even at this basic level and with such a 
limited and modest objective, a number of strategies can be usefully 
exploited to teach early reading comprehension. Some comprehension 
goals are, in fact, contained either explicitly or implicitly under 
other goal areas, such as morphology and lexis, as set forth above. 
Additional comprehension goals, which will be given special attention 
in the series, are listed below: 



1. Teaching some basic skills which require the ability to make use of 
contextual cues, such as: 

i. Supplying a missing element, such as a letter, a syllable, or a word. 

ii. Sequencing a group of scrambled words or sentences. 

iii. Deducing the meanings of some unfamiliar words from structural 
information (root, derivation, etc.) or contextual clues. 

iv. Recognition, understanding, and recall of specific and explicitly 
stated information and/or details. 



2. Teaching some skills which develop in the viewers the ability to interpret 
the text they are reading, such as: 

i. Paraphrasing a sentence or explaining it, verbally or through an 
activity. 

ii. Extracting information implicit in the text, on the basis of which 
information inferences can be made and conclusions drawn. 

iii. Articulating the main idea of a short text. 

iv. Judging the plausibility of a sentence. 
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ARABIC READING TEST 
CTW/AID TV READING SERIES PROJECT 
1985-1988 



Item Ob j . 
# Area 



Ob.lective 



Specific Task in the Item 



Item 

i 



specific Response Required 



1 A Aural discrimination of sounds 

in MSA 

2 A (Same as above) 



3 A Aural discrimination of sounds: 
■■yaa'" as a vcwel and consonant 



A A Aural discrimination of sounds: 
"waaw“ as a vowel and consonant 



5 B Recognize "nunation*' signs 



B Discriminate letters and 

distinguish them from other 
letters similar in dotting 
and/or shape 



Recognizes the word that contains the 
sound of a letter 

(Same as above) 



Identifies the written form of a word when 3 
student hears the word 



(Same as above) 



B (Same as above) 



B (Same as above) 



9 E Identify the letter at the end 
of a word 

10 E Identify semantically related 
words and concepts 



11 E (Same as above) 



12 E Recognize semantically related 
words and concepts 



13 E (Same as above) 



lA E (Same as above) 



15 E Recognize familiar antonyms 



16 E Choose the word denoting a 

certain baby animal 

17 E Choose the word denoting the 

sound of an animal 

18 E Identify idiomatic language 

connected with linguistic input 



19 E (Same ee above) 



Identifies the written form of a word when 
student hears the word 



Selects correct word from four choices 

(Same as above) 

(Same as above) 

Recognizes the letter at the end of a word 

Chooses a word that completes the sentence 
meaningfully 

(Same as above) 



Chooses a word that gives the moaning of 
another word (synonyms) 



(Same as above) 



(Samo as above) 



Selects correct antonym from four given 
choices 

Recognizes the word that describes the 
name of a baby animal 

Recognizes the word that describes the 
sound of an animal 

(Thoosas the correct answer completing a 
statement 



(Same es above) 



Recognizes the word that includes the 
sound of the letter “Thaa" 

Recognizes the word that includes tho 
sound of the letter "Daa“ 

Recognizes the written form of the 
word "dayn" (“debt'*) where the "yaa"’ 
is used a consonant after student 
hears the word 

Recognizes the written form of the 
word ’*usuud“ ("lions") when the 
‘‘waaw" is used as a vowel after 
student listens to the word, and 
distinguishes it from "waaw" as a 
consonant in "aswad" ("black"). 

Recognizes the written form of a word 
with "tanwiin annaSb" after student 
listens to the word, and 
distinguishes it from other kinds of 
"tanwtnn" 

Recognizes the word that includes tho 
letter (gh) in medial form 



7 Recognizes the word that includes the 
letter (H) in medial form 

8 Recognizes the word that includes the 
letter (K) in final form 

9 Specifies the letter "Kaaf* at the 
end of a given word 

10 Recognizes the word (meaning "the 

table") as the right choice to 
complete the sentence: The thing 

that is made of wood is... 

11 Recognizes the word (meaning 

"Barley") as the right choice to 
complete the sentence: Tho word that 

refers to one kind of cereal is... 

12 Recognizes e synonym of tho word 
"almanzil” meaning "the house" and 
its synonym "addaar" 

13 Recognizes "al-malaabis" as a synonym 
of the word "aththiyaab" meaning "the 
c lothes" 

lA Recognizes "qa9ada" os a synonym of 
the word "Jalasa” meaning "sat" 

15 Recognizes the antonym of the word 
"Saqhiil" meaning "small" 

16 Identifies the word "SuuS" as the one 
that describes a chick 

17 Identifies the word that describes 
the voice of the dog 

18 Recognizes the word that should bo 
said on the occasion when "he steps 
on his friend's foot un intent iaiaily" 

19 Recognizes the expression used wtien 
somebody says to him, "thanks,.." 
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Item Obj. Item 

Area Obiective Specific Task in the Item ± Specific Response Recruired 



20 F Utilize contextual meaning to 
supply a missing element 



(Same as above) 



20 Recognizes that the word **jawa9aan" 
meaning hungry is the proper vford to 
complete the sentence meaning: When 

you feel in need of food, you say I 
am. , , 



21 A Aural discrimination of sounds 

in MSA 

22 A (Same as above) 



23 A Aural discrimination of sounds: 
*'taa' marbutta" as a "taa'*’ and 
a ’’haa'" 



24 B Recognize diacritical and short 
vowel signs 



Recognizes the word that contains the 
sound of a letter 

(Same as above) 

Identifies the written form of a word 
when student hears the word 

(Same as above) 



21 Recognizes the word that includes the 
sound of the letter "Zaay" 

22 Recognizes the word that includes the 
sound of the letter "Dhaal'* 

23 Recognizes the written form of the 
word "bunaaton" ("builders") where 
*'taa' marbutta" is pronounced as a 
"taa'" after student listens to the 
word 

24 Recognizes the written form of the 
word "khayyal" after student listens 
to the word and distinguishes 

’■ shadda" 



25 


B 


Understand written material 
whenspelling and pronunciation 
do not correspond: e.g., sounds 
not represented in writing 


Identifies written form of a word wh«n 
student hears the word 


25 


Recognizes the written form of the 
word "haadhaa" when student hears the 
word 


26 


B 


Discriminate letters and 
distinguish them from other 
letters similar in dotting 
and/or shape 


Selects correct word from four choices 


26 


Recognizes the word that includes the 
letter (y) in medial form 


27 


B 


(Same as above) 


(Same as above) 


27 


Recognizes the word that includes the 
letter (9) in initial form 


28 


B 


Visual discrimination of the 
letters of the alphabet 


Chooses a word that contains a specified 
letter 


28 


Identifies the word that has a 
connected form of the letter "taa" 


29 


B 


Identify the letter at the 
beginning of a word 


Recognizes the letter at the beginning of 
a word 


29 


Specifies the letter "DHaa" at the 
beginning of a given word 


30 


E 


Recognize semantically related 
words and concepts 


Chooses a word that gives the meaning of 
another word (synonyms) 


30 


Recognizes the meaning of the word 
"Dhayl" meaning "tall" 


31 


E 


Recognize familiar antonyms 


Selects correct antonym from four given 
choices 


31 


Recognizes the antonymn of the word 
"Tawill" moaning "tall" 


32 


B 


Understand functions of 
punctuation marks 


Identifies punctuation mark to be placed 
at the end of a sentence 


32 


Given a question, recognizes it 
should end with a question mark 


33 


F 


Supply a missing element (a 
word) and deducing the meaning 
of the elonent froQ the oontext 


Chooses a word that cofnplates the sentence 
meaningfully 


33 


Recognizes the word (meaning "the 
cart") as the right one that 
completes the meaning of the 
sentence: The horse pulls... 


34 


F 


(Same as above) 


(Same as above) 


34 


Recognizes the word (meaning "Hair") 
as the right one that completes the 
meaning of the sentence; The barber 
cuts. . . 


35 


F 


(Same as above) 


(Same as above) 


35 


Recognizes the phrase (meaning "with 
the saw") as the right choice to 
complete the sentence: The carpenter 

cuts the wood. . . 


36 


E 


Identify semantically related 
words and concepts 


(Same as above) 


36 


Recognizes the word (meaning "the 
shirt") as the right choice to 
complete the sentence: Among the 

things we wear is. . . 


37 


C 


Recognize agreement pattern in 
person, gender, and number 
between verb and pronoun 


Chooses the verb that goes with a pronoun 


37 


RecogL izes the right form of the verb 
"tafhamu" that goes with the second 
singular pronoun "Ante" 
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Item 


Obj. 

Area CbUctiva 


Specific Task in the Item 


Item 

_£ 


Specific Response Reouired 


38 


C 


Racoftnlsa asiaamant in s«ndar, 
parson, and nucnbar batwaan tha 
varb and pronovtn 


Chooses the right form of pronoun that 
goes with given form of verb 


38 


Recognizes that the pronoun "naHnu" 
(we--plurel) is the form that goes 
with the verb "naktubu" maening "we 
write" 


39 


D 


Racosnixa inflactions associatad 
with varb moods 


Associates the right particle with a 
specific verb ending 


39 


Recognizes the type of word "neSb" 
preceding the verb which produced the 
mood in the verb 


AO 


C 


Racosnisa tha "dual” form of a 
noun 


Identifi<s a word that represents dual 
form of roun 


40 


Recognizes the word that represents 
two of the same thing among other 
words similar in sound and shape 


A1 


B 


Visual discrimination of tha 
latter s of tha alphabet 
Discriminate letters with 
identical or similar shapes but 
different dotting 


Recognizes a word that goes with a picture 
Key word has a letter similar in shape but 
different in dotting from another letter 
in the other options 


41 


Discriminates Zaey from Ree 


42 


B 


(Same as above) 


(Same as above) 


42 


Discriminates Thea from Yae, Baa, end 
Muun 


43 


B 


(Same as above) 


(Same as above) 


43 


Discriminates Dhael from Deal 


44 


B 


(Same as above) 


(Same as above) 


44 


Discriminates Siin from Shiin 


45 


B 


(Same as above) 


(Same as above) 


45 


Discriminates Dhaa from Taa 


46 


B 


(Same as above) 


(Same as above) 


46 


Discriminates Qeaf from Fee, and Saad 
from Daed 


47 


B 


(Same as above) 


(S«ne as above) 


47 


Diecriminetes Qeaf from Fae 


48 


E 


Word Recognition: Choose tha 

right word to describe a mode of 
locomotion 


Recognizes a word that goes with e picture 


48 


Recognizes the word "YaHbuu" meaning 
"to crawl" 


49 


E 


Recognize words in tha child's 
environment 


(Same as above) 


49 


Recognizes the word "Haefilah" 
meaning "bus" 


50 


E 


Word recognition: Semantically 

related words 


(Same as above) 


50 


Recognizes the word "YedHaku" meaning 
"to laugh" 


51 


E 


Word recognition: Families of 

words 


(Same as above) 


51 


Recognizes the word "Suuf" meaning 
"wool" as being associated to the 
picture of a lacnb 


52 


E 


Recognize derivational patterns 
based on the sane root 


(Sane as above) 


52 


Recognizes the word "Oalam" meaning 
"flag", discriminated from other 
words of the same root 


53 


E 


Recognize derivational patterns 
of words 


(Same as above) 


53 


Recognizes the word "Hammeal" meaning 
"porter" discriminated from other 
simllar-ln-shepe words 


54 


E 


Word recognition: Choose the 

right word to describe a trode of 
locomotion 


Identifies the word that goes with picture 


54 


Recognizes the word "yetewakke*" 
meaning "to lean against" 


55 


E 


(Sane as above) 


(Same as above) 


55 


Recognizes the word "yettaduu" meaning 
"to run" 


56 


E 


Word recognition: Semantically 

related words and concepts 


(Same as above) 


56 


Recognizes the word "webar" meaning 
"camel's wool" 


57 


E 


(Sane as above) 


(Same as above) 


57 


Recognizes the word "qearib 
shiraeQii" meaning "sailboat" 


58 


E 


(Sane as above) 


(Same as above) 


58 


Recognizes the word "Tea* ire 
Hawwa«ee" meaning "helicopter" 


59 


E 


Visual discrininetion of words 
in the child's environaent 


Chooses e picture that represents a word 


50 


Recognizes the picture of the sign 
for "danger" 


60 


E 


(Sane as above) 


(Same as above) 


60 


Recognizes the picture associated 
wlth/ralaud to "a hospital" 



O 
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Item CJbj. 

# Area 



Object iv 



Specific Teslc in the Item 



Item 



Specific Response Required 



61 E (Seme ei above) 



62 E (Same as above) 



63 £ (Same as above) 



64 E (Same as above) 

65 E Visual discrimination of words 

in the child's environment 



66 B Distinguish between numerals 

used in the Western and Eastern 
Arab countries 



67 B Know the Arabic alphabetical 
order 



68 B Discriminate between sounds 

represented by different 
letters: i.e., "haa"' and 

"tae ' " 

69 B Recognize diacritical and short- 

vowel signs 



70 A Aural discrimination of sounds: 
“alif* as a vowel and as a 
carrier of hamza 



71 E Identify semantically related 
words and concepts 



72 E Recognize the letters of the 
alphabet that form words 



73 E dioose the word denoting the 

sound of a specific animal 

74 C Recognize grammatical endings of 

nouns 



75 C Recognize proper ending of verb 

when preceded by a particle 

76 B Recognize sounds represented by 

different lettere or letter 
shepes 

77 D Recognize nominal and adjectival 

cases 



78 E Identify idiomatic language 

connected with linguietic input 



(Same as above) 


61 


Recognizes the picture which may be 
essocieted with "mail" 


(Same as above) 


62 


Recognizes the picture which may be 
related to "the library" 


(Same as above) 


63 


Recognizes the picture which may be 
related to "a restaurant" 


(Same as above) 


64 


Recognizes the picture which may be 
related to "a clinic" 


Chooses a picture that represents a word 


65 


Recognizes the picture of gasoline 
station to be related to the sign of 
"No Smoking" 


Given a numeral used in the Western 
countries student identifies the 
corresponding one in the Eastern countries 


66 


Recognizes the numeral used in 
Eastern Arab countries that 
corresponds to the numeral 8 used in 
Western Arab countries 


Given a series of ordered letters, 
student identifies the next letter 


67 


Recognizes the letter that comes next 
in order after a series of 4 ordered 
letters 


Identifies the written form of a word when 
student hears the word 


68 


Recognizes the written form of the 
word "kitaabetun" when student hears 
the word and distinguishes it from 
"haa', which is similar in shapc^ 


(Same as above) 


69 


Recognizes the written form of the 
word "earaane" after student listens 
to the word, and distinguishes 
"medde" from other diacritics and 
signs 


(Same as above) 


70 


Recognizes the written form of the 
word "sa'ala" when the "alif" is a 
carrier of "hamza" after student 
listens to the word and distinguishes 
it from the word with an "alif" that 
haa no "hamza" 


diooses a word that completes the sentence 
meaningfully 


71 


Recognizes the word "diinaer" as tha 
right one to complete the sentencs: 
The word that refers to money la... 


Recognizes the nixnber of letters that form 
a word 


72 


Specifies the mxober of letters in 
the word "al-muateqbal" ("the 
future") 


Recognizes the word that describes the 
sound of an animal 


73 


Identifies the word "Sehiil" that 
describes the voice of the horse 


diooses the form with the right ending 


74 


Recognizes that the form "attiflu" 
("child") is the right form when the 


Chooses the right ending of the verb 
preceded by one of the particles 


75 


Recognizes the form with the right 
ending of the verb "el9abu", when 
preceded by the particle "lura" 


diooses the word with the right letter 
shape in the context of the sentence 


76 


Recognizes that the word "9alae*‘ with 
"alif maq'auura" is the right form 
to be used in the sentence given 


Recognize i proper ending of adjective 


77 


Recognizes that the ending associated 
with the adjective is the "neSb" 
because the adjective ie the 
predicate of the auxiliary verb 
"Kaana" 


CThoosee the correct answer completing a 

statintnt 


78 


Recognizee the expreeeion to be used 
when "he visits a person that haa 
recently com back from a trip or 
Journey" 



BEST COPY AVAILABLE 
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It»m ObJ . 

♦ Area CbUctiv 



79 F Extract Information implicit in 
a taxt (infaranca) 



80 F Identify Inconsruent atataments 
with respect to familiar facts 



81 B Discriminate sounds represented 

by different letters: different 

ways of writing the "hamza" 
according to how it is 
pronounced 

82 B Identify diacritic si^ns used in 

known words 

83 E (Same as above) 



8A A Pronunciation and aural 

discrimination of sound in the 
case of the definite article ' al 
assimilated with "sun" but not 
"moon" letters 

85 A (Same as above) 



86 C Recosnize derivational analysis 

of related words“-derlved from 
the same root 

87 C (Same as above) 

88 C Recognize the "sound" feminine 

plural 

89 C Recognize grammatical endings 

(of plural form) 

90 C Recognize agreement pattern in 

gender between noun and 
adjective 

91 C Recognize agreement pattern in 

gender Indef Inlteneaa betwean 
noun end adjective 

92 C Recognize a«reeroent pattern in 

gender between plural adjectives 
and plural nouns 

93 C Recognize agreement pattern in 

person, gender, and number 
between pronoun and verb 

94 C Recognize knowledge of broken 

(irregular) plurals 



95 C Recognize the (sound) plural 

form of feminine nouns 

96 C Recognize vowel mutations in 

soma verbs 

97 E Identify idiomatic language 

connected with linguistic ixgzit 

98 C Recognizee agreement in gender, 

person, and numbaz between the 
verb end pronoun 



Specific Task in the Item 



Clhooaes the correct answer to a given 
question 



Identifies incorrect atetementa with 
respect to known facts 



Identifies the correct written form of the 
word when student hears the word 



Identifies the sign used on a letter of a 
four-letter word 

(Same as above) 



Identifies the word in which "al" (the) is 
not pronounced 



Identifies the word in which "el" (the) is 
not pronounced 



Identifies the word that has a different 
root from the others 



(Same as above) 



Identifies e word that represents (sound 
feminine plural) more than two of 
something 

Dioosea the right fora of noun 



Recognizes adjective that goes with a noun 



(Same as above) 



Chooses the adjective that goes with the 
noun 



cnioosea the verb that goes with a pronoun 



cnioosea the right fora of the plural 



Chooses the correct form of the plural 



Cliooaea the right fora of the verb 



Cliooaea the correct answer completing a 
statement 

Chooses the right form of pronoun thet 
goes with given fora of verb 



Item 

Jt 



Specific Response Required, 



79 Recognizes the expression eppropriete 

as an answer to the statement and 
questions : "Your mother made the 

dough and lit the oven; whet did she 
do next?" 

80 Recognizes the atetenent among other 
statements thet is incorrect with 
respect to known fects 

81 Recognizes the written fora of the 
word "su'lla" ("wes esked") when 
student hears the word 



82 Specifies the letter in a four-letter 
word thet has the "aukuun" sign 

83 Specifies the letter in a four-letter 
word that has the "shaddhe" sign 

84 Recognizes one word in which "al" 
("the") is pronounced (while in the 
other words it is not) 



85 Recognizes one word in which "al" 
("the") is not pronounced (while in 
the other words it is) 

86 Recognizes the word that has a 
different root (when the others are 
of the same root) 

87 Recognizes the word thet hes a 
different root among a gro»Jp of words 

88 Recognizes the word (sound feminine 
plurel) that represents toore than two 
things 

89 Recognizes the fora of noun related 
to the "raw case of the plural fora 

90 Recognizes the feminine adjective 
"Jamlllatun" that goes with the noun 
"Fateton" meaning "e girl" 

91 Recognizes the masculine adjective 
form "FeaDllun" thet goes with the 
noun "Rajulun" meaning "a man" 

92 Recognizes the plurel adjective 
"Seediqetun" that goes with the 
plural noun "nlaes'un" mMning wanm 

93 Recognizes the right fora of the verb 
"Benaytu" that goes with the first 
singular pronoun "Anea" 

94 Recognizes thet the fora "rijaalun" 
("men") la the right plurel of tha 
noun "rajulun" ("man") 

95 Recognizes the sound feminine plural 
as the proper one 

96 Recognizes that the form "qhefawtu" 
(I slept) la the one to be used 

97 Recognizes the expression to be used 
when "he greets a group of people" 

98 Recognizes that the pronoixi "ansa" 
(I) le the right fora that goes with 
the verb "aktubu" meaning "I write" 
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Itam ObJ . 
# Area 



Ob.iactiva 



Spaciflc Task in tha Itam 



I tarn 

# 



Sptcific Rasponsa Raoul rad 



99 C (Sama as abova) 



100 D Santanca pattams 



101 F Sequanca a s^oup of scramblad 

words; word ordar 

102 D Recosnlza basic comunlcativa 

santanca pattams: Tba 

exclamation 

103 F Identify incongruant statacnents 

with raspect to familiar facts 

104 D Understand non-simple 

stitemants: rationala of 

conjimctiva alamants 



10 S D Understand non-simpla sentences: 
rationale of the exceptive 
particle 



106 F Extract information implicit in 
a text (infaranca) 



107 F Extract information implicit in 

a text on tha basis of which 
inferences can be made 

108 F (Sama as above) 



109 F (Sama as abova) 



110 F (Sama as abova) 



111 F Extract information explicit in 
a text 



112 F (Sama as abova) 



113 F Extract information stated or 
implied in a text; giving main 
ideas in a short text 



114 F (Sama as abova) 



US F (Sama as abova) 



116 F Extract information and ideas 
implicit or explicit in a text 




(Sama as abova) 



Chooses tha right form of tha negative 
particle for past time and tense of tha 
verb 

Chooses tha appropriate grouping of words 
to form a meaningful santanca 

Chooses tha statement that gives tha 
meaning of tha given santanca 

Identifies which statement is correct with 
respect to known facts 

Chooses the option which gives tha meaning 
of a non -simple statement 



(Same as above) 



Chooses tha correct answer to a given 
question 



Chooses to mark "yes" or "no" as an answer 
to a question on information given 



(Sama as above) 

Chooses one word as an answer to tha 
question on information given 

Chooses one option on tha basis of tha 
information given 

Given a short text, student answers 
questions about information in tha text 



(Sama as abova) 



Chooses tha right answer to a question on 
a short text 



(Sama as abova) 



(Sana as abova) 



Chooses tha right answer to a question on 
tha text 



99 Recognizes that tha pronoun "humaa" 
(they— dual) is tha right form that 
goes with tha verb "la9ibaa** meaning 
"tha two of them played" 

100 Recognizes tha correct negative form 
to be used with tha verb "read" 



101 Recognizes tha meaningful grouping of 
words 

102 Given an exclamation sentence, 
student recognizes tha meaning 
underlying exclamation 

103' Given four statements, identifies one 
which is correct 

lOA Recognizes the effect of the 

conjunctive element "wa'and" and 
chooses the statement which provides 
this effect 

105 Recognizes the effect of the 
exceptive particle "illaa" meaning 
"except" and chooses the statement 
which agrees with the effect 

106 Recognizes the appropriate contextual 

answer to a statement followed by e 
question: "Satniir opened his bag and 

put his books in it; where did he go 
after that?" 

107 (Chooses a "yes" answer to the 
question on two statements 

108 Chooses a "no" answer to the question 
on the information given 

109 Chooses one word "Al-ghazaal" as an 
answer to the question requiring an 
inference from the information given 

110 Chooses one option as an answer co 
the question 

111 Recognizes the information in e text 
that is appropriate for answering a 
question about the text 

112 Recognizes the information in the 
text needed to answer a question 
about the text 

113 Given a short text followed by three 
questions in each, the student 
identifies the right answer based on 
Information in the text 

llA Given e short text followed by three 
questions in each, the student 
identifies the right answer based on 
information in the text 

115 Given a short text followed by three 
questions in eech, the student 
identifies the right answer bated on 
information in the text 

116 Given e short text, but slightly 
longer than the preceding one, the 
student identifies the right answer 
to a question 
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It Am Ob j . 

# Area OblACtiv 



117 F (Sam* ab abova) 



118 F (SamA as abova) 



119 F (Sama as abova) 



120 F (Sarna as abova) 



121 E Racosnlza nominal and adjectival 

forms from s^-ven basic form of 
tha varb (word familias) 

122 £ (Sama as abova) 



123 C Racosniza tha brokan plural 



124 C Discriminata batwaan tha 

singular and tha plural forms 



125 B Racosnixa lattars and symbols 

which ara writtan but not 

pronouncad: a.s<> "aliful- 

jamaa9a" 

126 B Racosniza lattars and symbols 

which ara writtan but not 
pronouncad "aliful-Jamaa*a" 

127 A Aural discrimination of 

intonation pattams 



123 A (Sama as abova) 



129 F Supply a mis sins a lament (a 

word) and daduca tha maanins 
tha alanant from tha contaxt 

130 D Racogniza tha tima isioclatlon 

with nagativa statamants 



131 C Racognlxa agraamant pattarn in 

gandar and n\anbar batwaan 
adjactiva and noun 

132 D Know tha influanca of 

"particlas" in nominal aantmicaa 



Specific Task in tha Itaro 

(Sma as abova) 



(Same as abova) 



(Sama as abova) 



(Sama as abova) 



Identifies tha word (darivad noun) that 
has tha sama rhyma as tha ona givan 



(S»a as abova) 



Identifies a word that raprasants mora 
than two things 



Idantifias tha word (noun) raprasanting 
ona thing (singular) 



Idantifias tha word writtan correctly 
among four given words 



Chooses tha word that is incorrectly 
writtan 



Specifies punctuation mark appropriate to 
a sentence heard with certain intonation 



(Same as abova) 



Chooses a word that coraplatas tha santanca 
meaningfully 

Recognizes tha adverb of time to ba 
associated with tha negative stataroant 

Crhoosas tha right form of adjective that 
goaa with a givan fozis of noun (plural 
faminina) 

Recognizes proper ending of pradlcata 



Item 

# Specific Rasponsa Required 



117 Given a abort text, but a lightly 
longer than tha preceding ona, tha 
student idantifias tha right answer 
to a question 

118 Given a short text, but slightly 
longer than tha preceding ona, tha 
student Identifies tha right answer 
to a question 

119 Given a short text, but slightly 
longer than tha preceding ona, tha 
student Identifies tha right answer 
to a question 

120 Given a short text, but slightly 
longer than tha preceding one, tha 
student idantifias tha right answer 
to a question 

121 Recognizes that ona of tha four words 
given has tha same rhyma as tha cna 
givan (nominal darlvatlva) 

122 Recognizes that ona of tha four words 
givan has tha sama rhyma as tha ona 
given (nominal darlvatlva) 

123 Recognizes tha word (brokan plural) 
that raprasants cnora than two, among 
other words similar in sound and 
writtan shape 

124 Recognizes tha word raprasanting ona 
thing among other words having 
similar sounds but which ara plural 
in roaaning 

125 Recognizes tha word "la91buu'‘ C'thay 
played") writtan correctly while tha 
other given words ara not 

126 Choosaa tha word incorrectly writtan 
though it is pronounced and looks 
like tha others, but "allful-Jamaada" 
should not have bean used 

127 After listening to a question, 
Identlflas tha question mark as tha 
appropriate ending punctuation 

128 After listening to an exclamatory 
santanca. idantifias tha exclamation 
mark as tha appropriate ending 
punctuation 

129 Recognizes the word (roaaning "coat") 

as tha right choice to comp lata tha 
santanca: The tailor makes... 

130 Recognizes tha time to ba associated 
with tha type of nagativa statement 
given as that of tha future 

131 Racognlzas Uiat tha right form of 
adjective is tha plural faminina 



132 Racognlzas that tha proper ending 

associated with tha predicate of tha 
governing particle "Inna and its 
aistars" is tha "raf9'* 
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It«n Cb j , 

# Area Ob,1«ctiv 



Spaciflc Task in th« It<m 



It*m 

# Sp«clflc R«spons« Reouirad 



133 D RecosniZtt tha asr««cnent In 

S«ndttr and nucobar (noun/varb) 



134 C GrarrmatlcaL endings o£ dual fozin 

In tha *‘raf9" casa 

135 C Racognlza agraamant in gandar, 

parson, and numbar batwaan tha 
verb and pronoun 

136 C Recognize proper ending of verb 

when preceded by a particle 

137 C Derive the plural form 



138 E Recognize tha word denoting a 

certain baby animal 

139 0 Identify patterns of questions 

and appropriate answers: Yas-Ko 

questions 

140 D Identify patterns of questions 

and appropriate answers: 
Information questions 

141 C Recognize proper ending of the 

verb when not preceded by a 
particle 

142 C Recognize passive and active 

verb forms 



143 C Passive and active verb forms 

144 C Recognize vowel nutations in 

some verbs 

145 C Identify patterns of adjectival 

comparisons using the feminine 



146 E Recognize the passive form of 

the verb which rhymee with 
another passive verb 
(metelinguietic tezia) 

147 E Recognize the word denoting e 

certain baby animal 

148 0 Recognize the time association 

with negative statements 



149 B Discriminate sounds represented 

by different letters: "Alif 

mamduuda** and ”alif maqsuura” 
and ”alif cirrying hsmze" 

130 E Use dictionaries and other 
reference materiel 

ISl C Identify patterns of adjectival 

compfirieons using the smacuUne 



Chooses the right form of verb 



Chooses the right form of noun 



Chooses the right form of pronoun that 
goes with given form of verb 



Chooses the right ending of the option 
verb 



Chooses the right form of plural 



Chooses the word that describes the name 
of the baby animal 

Chooses the correct answer to a given 
(Question 



(Same as above) 



Chooses the right ending of the verb 



Chooses the right form of the verb (active 
form) as required in the context 



Chooses the right form of the verb 
(passive ) 

Chooses the right form of the verb 



Recognizes agreement between the adjective 
and the noun (feminine) 



Identifies the verb that has the same 
rhyme as the one given (in the passive 
form) 



Chooses the word that describes the name 
of the baby animal 

Recognizes the adverb of time to be 
associated with the negative statement 



Identifiee the correct written form of the 
word when he hears the word 



Identifies name coming first in order in 
the telephone directory 

Recognizes agreement pattern between 
adjectival cooiperlson form end given noun 



133 Recognizes that the verb ''waSel** 
(arrived) is the right form to 
precede the noun, although the noun 
is duel end the verb is singular in 
form 

134 Recognizes the form of noun related 
to the "naSb” case of the duel form 

13 5 Recognizes that the pronoun **hum** 
(they — masculine plural) is the right 
form that goee with the verb 
"ketebuu" meaning ’’they wrote” 

136 Recognizes the verb with the right 
ending when it follows the particle 
”lea” 

137 Recognizes the ’’regular plural” form 
of the word ’’musaefimun” 
C’travellors”) 

138 Identifies the word that gives the 
name of e baby lion 

139 Recognizes the appropriate answer to 

the type of question: ’’Where does 

the child sleep?” 

140 Recognizes the appropriate answer to 

the question: ”0o you feel cold?” 



141 Recognizes tha verb with the right 
ending when it is not preceded by e 
particle 

142 Recognizes that the active form of 
the verb is to be used since it is 
followed by a subject end object 

143 Recognizes that the passive form of 
the verb is the one that fits 

144 Recognizes that the form ’’naSilu” (w« 
arrive) is the right one 

14 5 Chooses the word (adjective) that 
egreee with the noun (feminine form) 
as pert of e context 

146 Recognizes that one of the 4 verbs 
given has the same rhyme as the one 
given (in the passive form) 



147 Identifies the name for e lamb 



148 Recognizes the time to be associated 
with this type of negative statement 
as one in the pest 

149 Recognizes the written form of the 
word ’’ssbae” (’’captured”) where the 
”allf maq*suura” is used, when he 
hears the word 

150 Given 4 names, identifies which comes 
first In the telephone directory 

151 Chooses the word (adjective) that 
agrees with given noun as provided by 
the eentence context 



152 C Recognize proper ending of verb 
when preceded by a particle 




Chooses the right ending of the option 
verb 



Or 



BEST COPY AVAIIABLE 



152 Recognizee the verb with the right 
ending when it followe the particle 
” len” 



B-9 



it« 



Obj. 

Area 



Ct?.^ectlve 



Specific Teak in the Item 



Item 

__t 



Specific Reeponee Required 



133 E Use dlctlonerlet and other 
reference oiaterleL 



Aurel discrimination of 
intonation patterns 



155 B 



156 



157 



159 



160 



Understand functions of 
punctuation marks 



Recognize semanticaLLy related 
words and concepts: Location 

and direction 



(Same as above) 



Recognize semanticaLLy related 
words and concepts: used in 

agriculture 

Recognize semanticaLLy related 
words and concepts : used in 

health 

Recognize basic communicative 
sentence patterns: The 

affirmative statement 



Specifies type of reference materiel 
utilized for word meaning 



Specifies punctuation mark appropriate to 
e sentence heard with certain intonation 



Identifies puncutation mark to be placed 
at the end of e sentence 



Chooses the option (direction) which 
completes the statement 

(Same as above) 



Chooses an option that gives the meaning 
of e term used in agriculture 



Chooses an option that gives the meaning 
of e term used in health 



Chooses the statement that gives the 
meaning of the given sentence 



153 Given e nxsnber of reference 
materials, specifies which one can be 
used to lock for the msenir^ of words 

154 After listening to e declarative 
sentence, identifies the full stop as 
the appropriate ending punctuation 

155 Given e declarative statement, 
recognizes it should end with e full 
stop 

156 Recognizes that the West will be at 
his beck when he feces the sun in the 
morning 

157 Recognizes that the East will be to 
his right vhen he stands facing e map 

158 Recognizes the meaning of the term 
used in agriculture (*'wheat harvest") 



159 Recognizes the meaning of the term 
used in health ("inoculation'’) 



160 Given an effirmetive statement, 
student recognizes the underlying 
meaning 



o 
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Table Cl 

Subtest Correlations 







1 2 


3 


Sub test 
4 5 


6 


7 


8 1 






1 2 


3 


4 










1 Grade 1: Subtest 


1 


--- .66 


.62 


.62 










1 (N - 242) " 


2 


— 


.62 


.61 










f m 


3 




— 


.68 










I n 


4 




















2 


3 


4 


5 


6 






1 Grade 2: Sixbtest 


2 





.69 


.72 


.70 


.59 






1 (N - 611) " 


3 




— 


.66 


.62 


.48 






1 ** 


4 






— 


.68 


.55 






1 ** 


5 








— 


.67 






1 ** 


6 










“ “ “ 












3 


4 


5 


6 


7 




I Grade 3: Siibtest 


3 







.61 


.66 


.60 


.53 




1 (N - 247) " 


4 






— 


.69 


.63 


.59 




1 ** 


5 








— 


.72 


.70 




1 ** 


6 










— 


.68 




1 ** 


7 












“ ^ * 










3 


4 


5 


6 


7 


8 1 


1 Grade 4: Sub test 


3 







.60 


.56 


.59 


.57 


.50 1 


1 (N -323) 


4 






— 


.65 


.67 


.64 


.60 1 


1 ** 


5 








— 


.71 


.73 


.71 1 


1 ** 


6 










— 


.77 


.70 1 


1 ** 


7 












— 


.72 1 


1 ** 


8 
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Table C2 



Test Analysis Report Fom 
Total Test 

Jordan- Deceaber 1986 







Grade 1 


1 


Grade 2 


1 


Grade 3 


1 


Grade 4 








Percentile 


1 

1 


Percentile 


1 

1 


Percentile 


1 

1 


Percentile 




1 Raw 




Rank of 


1 


Rank of 


1 


Rank of 


1 


Rank of 




1 Score 




Lower Limit 


! 


Lower Limit 


1 


Lower Limit 


1 


Lower Limit 




I X 


f 


of Interval 


1 f 
1 


of Interval 


1 f 
1 


of Interval 


1 f 
1 


of Interval 




1111-114 






1 

1 




1 

1 




1 

1 1 


99.7 




1106-110 






1 




1 




1 5 


98.1 




1101-105 






1 




1 




1 1^ 


93.8 




1 96-99 






1 




1 




1 34 


83.1 




1 91-95 






1 2 


99.7 


1 3 


98.8 


1 26 


75.0 




1 86-90 






1 8 


98.4 


1 3 


97.6 


1 23 


67.8 




1 81-85 






1 9 


96.9 


1 28 


86.1 


1 32 


57.8 




1 76-80 






1 22 


93.3 


1 23 


76.7 


1 31 


48.1 




1 71-75 


3 


98.7 


1 39 


86.9 


1 22 


67.8 


1 16 


43.1 




1 66-70 


3 


97.5 


1 24 


83.0 


1 33 


54.3 


1 29 


34.1 




1 61-65 


2 


96.7 


I ^3 


75.9 


1 23 


44.9 


1 30 


24.7 




1 56-60 


3 


95.4 


1 •‘’2 


67.4 


1 21 


36.3 


1 22 


17.8 




1 51-55 


1 


95.0 


1 55 


58.4 


1 21 


27.8 


1 16 


12.8 




1 46-50 


0 


95.0 


1 73 


46.4 


1 9 


24.1 


1 17 


7.5 




1 41-45 


6 


92.5 


1 63 


36.1 


1 27 


13.1 


1 6 


5.0 




1 36-40 


13 


87.1 


1 64 


25.6 


1 13 


7.8 


1 ^ 


3.7 




1 31-35 


14 


81.3 


1 51 


17.2 


1 9 


4.1 


1 6 


1.9 




1 26-30 


39 


65.0 


1 36 


11.3 


1 7 


1.2 


1 2 


1.2 




1 21-25 


75 


33.7 


1 38 


5.1 


1 3 


0.0 


1 2 


0.6 




1 16-20 


49 


13.3 


1 20 


1.8 


1 




1 0 


0.6 




1 11-15 


25 


2.9 


1 7 


0.7 


1 




1 1 


0.3 




1 6-10 


5 


0.8 


1 2 


0.3 


1 




1 0 


0.3 




1 0-5 


2 


0.0 


1 2 


0.0 


1 




1 1 


0.0 








Grade 1 


1 


Grade 2 


1 


Grade 3 


1 


Grade 4 




iMean Score 


25.1 


1 

1 


47.8 


1 

1 


60.9 


1 

1 


74.2 




1 Standard 


Dev 


11.8 


1 


17.6 


1 


16.6 


1 


19.9 




1 Median 




22.9 


1 


47.0 


1 


63.4 


1 


76.3 




|Max Possible 


80.0 


1 

1 


100.0 


1 

1 


100.0 


1 

1 


120.0 
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Table C3 



Test Analysis Report Form 
Total Test 

Jordan - December 1987 





1 




Grade 1 


1 


Grade 2 


1 


Grade 3 


1 


Grade 4 






1 

1 




Percentile 


1 

1 


Percentile 


1 

1 


Percentile 




Percentile 




1 Raw 


1 




Rank of 


1 


Rank of 


1 


Rank of 




Rank of 




1 Score 


1 




Lower Limit 


1 


Lower Limit 


1 


Lower Limit 




Lower Limit 




1 ^ 


1 

1 


f 


of Interval 


1 f 
1 


of Interval 


1 f 
1 


of Interval 


1 f 


of Interval 




1111-114 


1 

1 






1 

1 




1 

1 




1 6 


97.2 




1106-110 


1 






1 




1 




1 19 


90.5 




1101-105 


1 






1 




1 




1 37 


77.5 




1 96-99 


1 






1 




1 2 


99.1 


1 26 


68.4 




1 91-95 


1 






1 3 


99.5 


1 1^ 


93.0 


1 40 


54.4 




1 86-90 


1 






1 6 


98.4 


1 13 


87.4 


1 28 


44.6 




1 81-85 


1 






1 20 


94.9 


1 23 


77.4 


1 19 


37.9 




1 76-80 


1 






1 20 


91.4 


1 24 


67.0 


1 24 


29.5 




1 71-75 


1 


1 


99.5 


1 39 


84.6 


1 32 


53.0 


1 17 


23.5 




1 66-70 


1 


1 


99.0 


1 ^5 


76.7 


1 24 


42.6 


1 13 


18.9 




1 61-65 


1 


2 


97.9 


I 61 


66.0 


1 16 


34.8 


1 1^ 


14.0 




1 56-60 


1 


1 


97.4 


1 78 


52.3 


1 16 


27.0 


1 9 


10.9 




1 51-55 


1 


4 


95.4 


1 65 


40.9 


1 21 


17.8 


1 6 


8.1 




1 46-50 


1 


7 


91.8 


1 64 


29.6 


1 16 


10.9 


1 6 


6.0 




1 41-45 


1 


13 


85.1 


1 71 


17.2 


1 11 


6.1 


1 5 


4.2 




1 36-40 


1 


30 


69.7 


1 ^3 


9.6 


1 6 


2.6 


1 7 


1.8 




1 31-35 


1 


34 


52.3 


1 24 


5.4 


1 2 


1.7 


1 3 


0.7 




1 26-30 


1 


37 


33.3 


1 16 


2.3 


1 1 


1.3 


1 1 


0.4 




1 21-25 


1 


39 


13.3 


1 6 


0.9 


1 2 


0.4 


1 1 


0.0 




1 16-20 


1 


21 


2.6 


1 5 


0.0 


1 1 


0.0 








1 11-15 


1 


3 


1.0 


1 




1 










1 6-10 


1 


1 


0.5 


1 




1 










1 0-5 


1 


1 


0.0 


1 




1 
















Grade 1 


1 


Grade 2 


1 


Grade 3 




Grade 4 




■Mean Score 


31.1 


1 

1 


54.5 


1 

1 


66.9 




83.5 




1 Standard 


Dev 


10.6 


1 


14.9 


1 


16.6 




19.8 




1 Median 






30.0 


1 


54.3 


1 


69.7 




88.1 




|Hax Possible 


80.0 


1 

1 


100.0 


1 

1 


100.0 




120.0 






100 



Table C4 



Test Analysis Report Fora 
Core Test 

Jordan - Deceaber 1986 





1 




Grade 1 


1 


Grade 2 


1 


Grade 3 


1 


Grade 4 






1 

1 




Percentile 


1 

1 


Percentile 


1 

1 


Percentile 


1 

1 


Percentile 




j Raw 


1 




Rank of 


1 


Rank of 


1 


Rank of 


1 


Rank of 




1 Score 


1 




Lower Limit 


1 


Lower Linit 


Lower Limit 


1 


Lower Limit 




1 X 


I 

1 


f 


of Interval 


1 f 
1 


of Interval 


1 f 
1 


of Interval 


1 f 
1 


of Interval 




1 39-40 


1 

1 






1 

1 




1 

1 3 


98.8 


1 

1 


98.7 




1 37-38 


1 


1 


99.6 


1 ^ 


99.3 


1 8 


95.5 


1 19 


92.8 




1 35-36 


1 


1 


99.2 


1 7 


98.2 


1 23 


86.1 


1 ^1 


80.0 




1 33-34 


1 


4 


97.5 


I 16 


95.6 


1 35 


71.8 


1 36 


68.8 




1 31-32 


1 


2 


96.7 


1 ^2 


88.7 


1 25 


61.6 


1 51 


52.8 




1 29-30 


1 


2 


95.8 


1 62 


78.5 


1 ^2 


44.5 


1 36 


41.6 




1 27-28 


1 


0 


95.8 


1 52 


70.0 


1 28 


33.1 


1 ^7 


26.9 




1 25-26 


1 


1 


95.4 


1 54 


61.1 


1 24 


23.3 


1 31 


17.2 




1 23-24 


1 


2 


94.6 


1 61 


51.1 


1 22 


14.3 


1 1^ 


12.8 




1 21-22 


1 


3 


93.3 


1 52 


42.6 


1 8 


11.0 


1 13 


8.7 




1 19-20 


1 


7 


90.4 


1 ^3 


35.6 


1 9 


7.3 


1 6 


6.9 




1 17-18 


1 


9 


86.7 


1 51 


27.2 


1 ^ 


5.7 


1 7 


4.7 




1 15-16 


1 


21 


77.9 


1 ^7 


19.5 


1 5 


3.7 


1 5 


3.1 




I 13-14 


1 


36 


62.9 


1 50 


11.3 


1 ^ 


2.0 


1 ^ 


1.9 




1 11-12 


1 


52 


41.2 


1 29 


6.6 


1 ^ 


0.4 


1 2 


1.2 




1 9-10 


1 


31 


28.3 


1 18 


3.6 


1 0 


0.4 


1 ^ 


1.2 




1 7- 8 


I 


33 


14.6 


1 8 


2.3 


1 1 


0.0 


1 1 


0.9 




1 5- 6 


1 


18 


7.1 


1 8 


1.0 


1 




1 2 


0.3 




1 3- 4 


1 


14 


1.2 


1 ^ 


0.3 


1 




1 0 


0.3 




1 0- 2 


1 

1 


3 


0.0 


1 2 
1 


0.0 


1 

1 




1 1 
1 


0.0 










Grade 1 


1 


Grade 2 


1 


Grade 3 


1 


Grade 4 




|Hean Score 


11.9 


1 

1 


21.6 


1 

1 


28.3 


1 

1 


29.1 I 


{Standard 


Dev 


6.1 


1 


7.3 


1 


6.0 


1 


6.3 




jHedian 






11.2 


1 


22.3 


1 


29.0 


1 


30.1 




|Max Possible 


40.0 


1 

1 


40.0 


1 

1 


40.0 


1 

1 


40.0 
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Table C5 



Test Analysis Report For® 
Core Test 

Jordan - Decea^r 1987 



i 1 




Grade 1 


1 


Grade 1 


1 


Grade 3 


1 


Grade 4 


i 

-1 


i 1 
1 1 




Percentile 


1 

1 


Percentile 




Perceiitile 




Percentile 


1 


1 Raw 1 




Rank of 


1 


Rank of 




Rank of 




Rank of 




I Score 1 




Lower Limit 


1 


Lower Limit 




Lower Limit 




Lower Limit 




1 X 1 
1 1 


f 


of Interval 


1 f 
1 


of Interval 


1 f 


of Interval 


1 f 


of Interval 




1 1 
1 39-40 1 






1 

1 




1 1^ 


93.9 


I ^1 


85.6 




1 37-38 1 


1 


99.5 


1 6 


98.9 


1 18 


86.1 


1 48 


68.8 




1 35-36 1 


0 


99.5 


1 17 


96.0 


1 23 


76.1 


1 ^5 


53.0 




1 33-34 I 


1 


99.0 


1 29 


90.9 


1 22 


66.5 


1 36 


40.4 




1 31-32 1 


1 


98.5 


1 52 


81.8 


1 32 


52.6 


1 29 


30.2 




1 29-30 1 


4 


96.4 


1 49 


73.2 


1 26 


41.3 


1 31 


19.3 




1 27-28 1 


3 


94.9 


1 68 


61.2 


1 21 


32.2 


1 17 


13.3 




1 25-26 1 


5 


92.3 


1 64 


50.0 


1 2’ 


23.0 


1 9 


10.2 




1 23-24 1 


4 


90.3 


1 55 


40.4 


1 20 


74.3 


1 ^ 


8.8 




1 21-22 1 


6 


87.2 


1 60 


29.8 


1 11 


9.6 


1 8 


6.0 




1 19-20 1 


12 


81.0 


1 53 


20.5 


1 7 


6.5 


1 ^ 


4.6 




1 17-18 1 


27 


67.2 


1 34 


14.6 


1 8 


3.9 


1 8 


2.5 




1 15-16 1 


37 


48.2 


1 31 


9.1 


1 2 


3.0 


1 1 


2.1 




I 13-14 1 


24 


35.9 


1 15 


6.5 


1 2 


2.2 


1 2 


1.4 




1 11-12 1 


34 


18.5 


1 15 


3.9 


1 2 


1.3 


1 3 


0.4 




1 9-10 1 


21 


7.7 


1 13 


1.6 


1 1 


0.9 


I 1 


0.0 




1 7- 8 1 


9 


3.1 


1 5 


0.7 


1 1 


0.4 








1 5- 6 1 


3 


1.5 


1 ^ 


0.0 


1 1 


0.0 








1 3- 4 1 


3 


0.0 


1 














1 0- 2 1 
j 1 






1 

1 


















Grade 1 


1 


Grade 2 




Grade 3 




Grade 4 




IHean Score 


15.0 


1 

1 


24.0 




29.2 




32.6 




j Standard 


Dev 5 . 6 


1 


6.8 




6 . 6 




6.2 




1 Median 




14.7 


1 


24.5 




30.1 




34.1 




|Max Possible 40.0 


1 

1 


40.0 




40.0 




40.0 


1 
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Table C6 



Test Analysis Report Form 
Total Test 

Morocco - January 1987 



1 

1= — __ 


1 


Grade 1 


1 


Grade 2 


1 


Grade 3 


1 


Grade 4 




i 

1 

1 

1 Raw 
1 Score 
1 X 

1 


1 f 


Percentile 
Rank of 
Lower Limit 
of Interval 


1 

1 

1 

1 

1 f 
1 


Percentile 
Rank of 
Lower Limit 
of Interval 


1 

1 

1 

1 

1 f 
1 


Percentile 
Rank of 
Lower Limit 
of Interval 


1 

1 

1 

1 

1 f 
1 


Percentile 
Rank of 
Lower Limit 
of Interval 




1 

j 111-114 






1 

1 




1 

1 




1 

1 






1106-110 






1 




1 




1 






1101-105 






1 




1 




1 






1 96-99 






1 




1 




1 6 


91.4 




1 91-95 






1 1 


99.4 


1 2 


98.1 


1 1 


90.0 




1 86-90 






1 5 


96.6 


1 8 


90.5 


1 8 


78.6 




1 81-85 






1 16 


87.4 


1 10 


81.0 


1 7 


68.6 




1 76-80 






1 30 


70.3 


1 9 


72.4 


I 12 


51.4 




1 71-75 






1 20 


58.9 


1 17 


56.2 


1 16 


28.6 




1 66-70 






1 20 


47.4 


1 16 


41.0 


1 8 


17.1 




1 61-65 


1 6 


95.6 


1 19 


36.6 


1 1^ 


27.6 


1 ^ 


11.4 




1 56-60 


1 11 


87.4 


1 1^ 


28.6 


1 11 


17.1 


1 5 


4.3 




1 51-55 


1 20 


72.6 


1 18 


18.3 


1 9 


8.6 


1 1 


2.9 




1 46-50 


1 1^ 


62.2 


1 13 


10.9 


i 5 


3.8 


1 1 


1.4 




1 41-45 


1 13 


52.6 


1 6 


7.4 


1 1 


2.9 


1 1 


0.0 




1 36-40 


1 18 


39.3 


5 


4.6 


1 




1 






1 31-35 


1 1 ^ 


28.9 


1 ^ 


2.3 


I 




1 






1 26-30 


1 11 


20.7 


1 2 


1.1 


1 




1 






1 21-25 


1 13 


11.1 


1 1 


0.6 


1 




1 






1 16-20 


1 8 


6.7 


1 1 


0.0 


1 




1 






1 11-15 


1 1 


5.9 


1 




1 




1 






1 6-10 






1 




1 




1 






1 0-5 

1 






1 




1 




1 






1 

1 




Grade 1 


1 


Grade 2 


1 


Grade 3 


1 


Grade 4 




1 

1 

|Mean Score 


39.3 


1 

1 


64.5 


1 

1 


68.2 


1 

1 


75.7 




1 Standard 


Dev 


14.4 


1 


15.0 


1 


12.5 


1 


11.7 




1 Median 




40.0 


1 


66.4 


1 


69.1 


1 


75.2 




|Max Possible 
1 


80.0 


1 

1 


100.0 


1 

1 


100.0 


1 

1 


120.0 
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C-7 



Table C7 

Test Analysis Report Form 
Core Test 

Morocco - January 1987 





1 


Grade 1 




Grade 2 


1 


Grade 3 


1 


Grade 4 






Percentile 




Percentile 




Percentile 




Percentile 


Raw 




Rank of 




Rank of 




Rank of 




Rank of 


Score 




Lower Limit 




Lower Limit 




Lower Limit 




Lower Limit 


X 


1 f 


of Interval 


1 f 


of Interval 


1 f 


of Inteirval 


1 f 


of Interval 


39-40 


















37-38 










1 3 


97.1 


1 1 


98.6 


35-36 






1 10 


94.3 


1 12 


85.7 


1 2 


95.7 


33-34 






1 13 


86.9 


1 13 


73.3 


1 15 


74.3 


31-32 






1 21 


74.9 


1 12 


61.9 


1 16 


51.4 


29-30 


1 2 


98.5 


1 25 


60.6 


1 15 


47.6 


1 16 


25.7 


27-28 


1 


88.1 


1 24 


46.9 


1 17 


31.4 


1 9 


12.9 


25-26 


1 11 


80.0 


1 20 


35.4 


1 8 


23.8 


1 ^ 


7.1 


23-24 


1 15 


68.9 


1 20 


24.0 


1 9 


15.2 


1 1 


5.7 


21-22 


1 15 


57.8 


1 1^ 


16.0 


1 9 


6.7 


1 2 


2.9 


19-20 


1 8 


51.9 


1 11 


9.7 


1 ^ 


2.9 


1 1 


1.4 


17-18 


1 7 


46.7 


1 8 


5.1 


1 2 


1.0 


1 1 


0.0 


15-16 


1 15 


35.6 


1 1 


4 . 6 


1 0 


1.0 






13-14 


1 1^ 


25.2 


1 ^ 


2.3 


1 0 


1.0 






11-12 


1 11 


17.0 


1 1 


1.7 


1 1 


0.0 






9-10 


1 5 


13.3 


1 2 


0.6 










7- 8 


1 9 


6.7 


1 0 


0.6 










5- 6 


1 ^ 


3.7 


1 1 


0.0 










3- 4 


1 5 


1.5 














0- 2 


1 2 


0.0 


















Grade 1 




Grade 2 




Grade 3 




Grade 4 


Mean Score 


17.6 




26.2 




28.5 




30.0 


Standard Dev 7 . 1 




5.8 




5.2 




3.6 


Median 


17.9 




26.9 




28.8 




30.4 


Max Possible 40.0 




W.O 




40.0 




40.0 



O 
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C-8 



Table C8 



Test Analysis Report Form 
Total Test 

Tunisia - January 1987 



j 




Grade 1 


1 


Grade 2 


1 


Grade 3 


1 


Grade 4 








Percentile 


1 

1 


Percentile 


1 

1 


Percentile 


1 

1 


Percentile 




I Raw 




Rank of 


1 


Rank of 


1 


Rank of 


1 


Rank of 




1 Score 




Lower Limit 


1 


Lower Limit 


1 


Lower Limit 


I 


Lower Limit 




1 X 


f 


of Interval 


1 f 
1 


of Interval 


1 f 
1 


of Interval 


1 f 
1 


of Interval 




1111-114 






1 

1 




1 

1 




1 

1 2 


97.1 




1106-110 






1 




1 




I 1 


95.7 




1101-105 






1 




1 




1 2 


92.9 




1 96-99 






1 




1 




1 5 


85.7 




1 91-95 






1 




1 




1 6 


77.1 




I 86-90 






1 1 


99.6 


I 




i 8 


65.7 




1 81-85 






1 8 


96.5 


1 




1 10 


51.4 




1 76-80 






I 12 


91.9 


1 7 


88.3 


1 15 


30.0 




1 71-75 






I 19 


84.6 


1 1 


86.7 


1 12 


12.9 




I 66-70 


1 


98.5 


1 16 


78.5 


1 5 


78.3 




7.1 




I 61-65 


2 


95.4 


I 24 


69.2 


1 10 


61.7 


1 3 


2.9 




1 56-60 


3 


90.8 


I 23 


60.4 


1 7 


50.0 


1 1 


1.4 




1 51-55 


2 


87.7 


1 28 


49.6 


1 9 


35.0 


1 1 


0.0 




1 46-50 


3 


83.1 


1 28 


38.8 


1 6 


21.7 


1 






I 41-45 


8 


70.8 


I 23 


30.0 


1 1 


20.0 


1 






I 36-40 


14 


49.2 


I 30 


18.5 


1 ^ 


13.3 


1 






1 31-35 


7 


38.5 


1 28 


7.7 


1 5 


5.0 


1 






1 26-30 


7 


27.7 


1 7 


5.0 


1 2 


1.7 


i 






1 21-25 


5 


20.0 


I 10 


1.2 


1 1 


0.0 


I 






1 16-20 


3 


15.4 


I 1 


0.8 


1 




1 






I 11-15 


6 


6.2 


1 0 


0.8 


1 




I 






I 6-10 


3 


1.5 


1 2 


0.0 


1 




1 






I 0-5 


1 


0.0 


1 




1 




1 










Grade 1 


1 


Grade 2 


1 


Grade 3 


1 


Grade 4 




|Mean Score 


33.6 


1 

1 


51.4 


1 

1 


54.9 


1 

1 


82.0 




1 Standard 


Dev 


14.5 


1 


16.1 


1 


14.4 


1 


12.1 




1 Median 




35.6 


1 


50.8 


1 


55,5 


1 


80.2 




|Max Possible 


80.0 


1 

1 


100.0 


1 

1 


100.0 


1 

1 


120.0 
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C-9 



Table C9 



Test Analysis Report Fom 
Core Test 

Tjnlsia - January 1987 



1 1 




Grade 1 


i 


Grade 2 { 


1 


Grade 3 


1 Grade 4 








Percentile 




Percentile 




Percentile 


1 Percentile 




1 Raw 1 




Rank of 




Rank of 




Rank of 


1 Rank of 




1 Score 1 




Lower Limit 




Lower Limit 




Lower Limit 


1 Lower Limit 




1 ^ 1 


f 


of Interval 


1 f 


of Interval 


f 


of Interval 


1 f of Inteirval 




1 39-40 1 














1 3 95.7 




1 37-38 1 














1 4 90.0 




1 35-36 1 






1 2 


99.2 


2 


96.7 


1 11 74.3 




1 33-34 1 


1 


98.5 


I 10 


95.4 


2 


93.3 


1 13 55.7 




1 31-32 1 


0 


98.5 


1 25 


85.8 


5 


85.0 


1 21 25.7 




1 29-30 1 


1 


96.9 


1 20 


78.1 


12 


65.0 


1 11 10.0 




1 27-28 1 


2 


93.8 


1 26 


68.1 


8 


51.7 


1 5 2.9 




1 25-26 1 


3 


89.2 


1 31 


56.2 


5 


43.3 


1 2 0.0 




1 23-24 1 


0 


89.2 


1 23 


47.3 


12 


23.3 






1 21-22 1 


2 


86.2 


1 28 


36.5 


2 


20.0 






1 19-20 1 


4 


80.0 


1 15 


30.8 


5 


11.7 






1 17-18 1 


4 


73.8 


1 16 


24.6 


2 


8.3 






1 15-16 1 


6 


64.6 


1 22 


16.2 


3 


3.3 






1 13-14 1 


8 


52.3 


1 17 


9.6 


0 


3.3 






I 11-12 1 


7 


41.5 


1 11 


5.4 


0 


3.3 






1 9-10 1 


9 


27.7 


1 5 


3.5 


1 


1.7 






1 7- 8 1 


8 


15.4 


1 3 


2.3 


0 


1.7 






1 5- 6 1 


1 


13.8 


1 3 


1.2 


1 


0.0 






1 3-4 1 


6 


4.6 


1 3 


0.0 










1 0 - 2 1 


3 


0.0 


















Grade 1 




Grade 2 




Grade 3 


1 Grade 4 




Mean Score 


13.0 




22.3 




25.3 


1 32.4 




■Standard Dev 7.2 




7.2 




5.8 


1 3.1 




1 Median 




12.1 




23.2 




26.0 


1 32.2 




{Max Possible 40.0 




40.0 




40.0 


1 40.0 
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Table CIO 



Deltas and R-Biserials 
Jordan - Decesber 1986 









Core 


Test 






Total 


Test 








Delta 1 


G1 


G2 


G3 


G4 1 


1 G1 


G2 


G3 


G4 






19.0 up i 






















18.0-18.9 1 


3 


2 






1 ^ 


2 










17.0-17.9 1 


5 


1 


2 


1 1 


1 9 


1 


4 


1 






16.0-16.9 1 


4 


1 


0 


0 1 


1 8 


10 


2 


3 






15.0-15.9 1 


13 


2 


0 


0 1 


1 23 


11 


3 


4 






14.0-14.9 1 


7 


6 


0 


0 1 


1 20 


19 


5 


10 






13.0-13.9 1 


5 


4 


6 


6 1 


1 7 


11 


17 


18 






12.0-12.9 1 


2 


7 


4 


^ 1 


1 8 


19 


19 


21 






11.0-11.9 1 


1 


4 


5 


5 1 


1 1 


8 


13 


21 






10.0-10.9 1 




7 


3 


5 1 




10 


13 


12 






9. 0-9. 9 1 




4 


5 


^ 1 




5 


7 


12 






8. 0-8. 9 1 




1 


6 


^ 1 




1 


7 


6 






7. 0-7. 9 1 




1 


7 


7 1 




3 


7 


8 






6.0-down 1 








3 1 






1 


3 






Total 1 


40 


40 


40 


40 i 


1 80 


100 


100 


120 






Mean | 


15.3 


12. 


6 10.1 


10.2 1 


1 15.1 


13.2 


11.7 


11.6 






S.D. I 


1.6 


2. 


5 2.8 


2.6 1 


1 1.6 


2.3 


2.6 


2.4 






-bis 1 






















.90-. 99 1 






2 


1 1 






2 


1 






.80-. 89 1 






2 


3 1 






1 


0 






.70-. 79 1 


2 


8 


5 


6 1 


1 2 


8 


9 


12 






.60-. 69 1 


6 


9 


9 


9 1 


1 9 


19 


24 


24 






.50-. 59 1 


7 


7 


7 


9 1 


1 15 


31 


24 


40 






.40-. 49 1 


11 


9 


9 


6 1 


1 20 


19 


15 


18 






.30-. 39 1 


10 


5 


5 


5 1 


1 18 


13 


13 


12 






.20-. 29 1 


1 


0 


0 


1 1 


1 10 


5 


8 


7 






.10-. 19 1 


2 


2 


1 




1 3 


2 


2 


3 






.00-. 09 1 


1 








1 2 


2 


0 


2 






Negative | 










1 1 


1 


2 


1 






Total 1 


40 


40 


40 


40 1 


1 80 


100 


100 


120 






Mean | 


.46 


.53 


.55 


.58 1 


1 -^2 


.50 


.50 


.51 






S.D. 1 


.15 


.16 


.15 


.15 1 


1 .16 


.16 


.18 


.16 
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C-11 



Table Cll 

Deltas and R-Biserials 
Jordan - Decenber 1987 







Core 


Test 




II 




Total 


Test 






1 Delta 


G1 


G2 


G3 


G4 


II 


Cl 


G2 


G3 


G4 














1 1 












1 19 . 0 up 










II 












1 18.0-18.9 


1 


1 






II 


1 


1 








1 17.0-17.9 


2 


0 






II 


3 


0 








1 16.0-16.9 


7 


0 






II 


12 


2 




2 




1 15.0-15.9 


9 


3 


1 




II 


16 


9 


1 


3 




1 14.0-14.9 


3 


4 


2 




II 


12 


14 


8 


7 




1 13.0-13.9 


9 


7 


1 




II 


15 


24 


9 


6 




1 12.0-12.9 


5 


4 


8 


5 


II 


13 


13 


19 


16 




1 11.0-11.9 


3 


5 


3 


4 


II 


5 


10 


13 


18 




1 10.0-10.9 


0 


6 


5 


4 


II 


2 


11 


19 


21 




1 9. 0-9. 9 


0 


4 


7 


8 


II 


0 


7 


15 


18 




1 8. 0-8. 9 


0 


5 


3 


6 


II 


0 


7 


4 


14 




1 7. 0-7. 9 


1 




9 


2 


II 


1 


0 


11 


4 




1 6.0-down 








3 


II 




1 




3 














II- 












1 Total 


40 


40 


40 


40 


II 


80 


100 


100 


120 




1 Mean 


14.4 


11. 


8 10.2 


8.9 


II 


14.2 


12.4 


11.0 


10.6 




1 S.D. 


2.1 


2. 


5 2.3 


2.2 


II 


1.9 


2.3 


2.1 


2.4 














“1 1*“ 
II 












1 £bis 










II 






















II 












1 .90-. 99 




1 


1 


8 


II 




1 


1 


8 




1 .80-. 89 




1 


2 


2 


II 




0 


2 


3 




1 .70-. 79 




3 


7 


9 


II 




2 


12 


18 




1 .60-. 69 


4 


6 


9 


11 


II 


4 


7 


22 


26 




1 .50-. 59 


5 


12 


14 


3 


II 


17 


32 


21 


30 


1 


1 .40-. 49 


11 


11 


5 


5 


II 


18 


27 


25 


10 


1 


1 .30-. 39 


10 


4 


1 


1 


II 


15 


18 


10 


17 




1 .20-. 29 


6 


0 


1 


0 


II 


8 


5 


4 


2 




1 .10-. 19 


4 


1 




0 


II 


10 


2 


2 


2 




1 .00-. 09 




1 




1 


II 


7 


4 


1 


1 




1 Negative 










II 


1 


2 




3 


























1 Total 


40 


40 


40 


40 


II 


80 


100 


100 


120 




1 Mean 


.39 


.52 


.60 


.61 


II 


.36 


.43 


.52 


.53 




1 S.D. 


.14 


.15 


.13 


.15 


II 


.17 


.16 


.16 


.19 
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Table C12 



Deltas and R-Biserials 
Morocco - January 1987 









Core 


Test 




li 




Total 


Test 








Delta 1 


G1 


G2 


G3 


G4 


il 


G1 


G2 


G3 


G4 






19.0 up 1 


1 


1 






1 1 
II 


1 


1 










18.0-18.9 1 


2 


0 






II 


3 


0 


1 


1 






17.0-17.9 1 


1 


0 


0 


1 


II 


2 


0 


2 


6 






16.0-16.9 1 


4 


3 


0 


0 


II 


4 


6 


0 


3 






15.0-15.9 1 


5 


0 


3 


2 


II 


5 


1 


5 


8 






14.0-14.9 1 


3 


5 


2 


1 


II 


11 


8 


5 


5 






13.0-13.9 1 


11 


2 


3 


2 


II 


19 


8 


8 


11 






12.0-12.9 1 


2 


3 


4 


3 


II 


9 


15 


10 


17 






11.0-11.9 1 


4 


4 


3 


3 


II 


10 


13 


15 


14 






10.0-10.9 1 


4 


7 


5 


7 


II 


9 


16 


12 


16 






9. 0-9. 9 1 


2 


5 


7 


5 


II 


4 


10 


16 


11 






8.0-8. 9 1 


1 


2 


2 


1 


II 


3 


11 


7 


4 






7. 0-7. 9 1 




5 


6 


7 


II 




7 


11 


12 






6.0-down j 




3 


0 


2 


II 




3 


1 


3 






Total 1 


40 


40 


40 


40 


- 1 1 
II 


80 


100 


100 


120 






Mean | 


13.7 


11. 


1 10.2 


9. 


1 1 1 


13.1 


11.2 


10.7 


11.3 






S.D. 1 


2.6 


3. 


2 2.8 


3. 


0 II 


2.4 


2.7 


2.8 


3.2 






—bis 1 










1 1 
II 
II 














.90-. 99 1 


1 


1 


5 


6 


1 1 
II 


2 


2 


7 


9 






.80-. 89 1 


4 


1 


0 


1 


II 


3 


2 


0 


0 






.70-. 79 1 


2 


4 


3 


0 


II 


13 


12 


6 


7 






.60-. 69 1 


10 


8 


5 


4 


II 


14 


12 


10 


6 






.50-. 59 1 


5 


8 


10 


5 


II 


12 


25 


21 


20 






.40-. 49 1 


10 


9 


6 


5 


II 


15 


19 


17 


13 






.30-. 39 1 


4 


4 


6 


7 


II 


11 


15 


22 


20 






.20-. 29 1 


0 


3 


3 


6 


II 


3 


5 


9 


16 






.10-. 19 1 


0 


2 


1 


3 


II 


4 


5 


2 


16 






.00-. 09 1 


3 


0 


1 


1 


II 


0 


2 


3 


8 






Negative | 


1 


0 


0 


2 


II 


3 


1 


2 


5 






Total 1 


40 


40 


40 


40 


II 


80 


100 


100 


120 






Mean | 


.52 


.51 


.48 


.37 


II 


.50 


.49 


.43 


.35 






S.D. 1 


.21 


.16 


.15 


.21 


II 


.21 


.18 


.18 


.22 
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C-13 



Table Cl 3 

Deltas and R-Blserlals 
Tunisia - January 1987 







Core 


Test 




II 




Total 


Test 






1 Delta 


G1 


G2 


G3 


G4 


II 

-I 


G1 


G2 


G3 


G4 




1 19 . 0 up 


6 


3 


2 




1 1 
II 


7 


3 


2 






1 18.0-18.9 


1 


0 


0 


1 


II 


2 


0 


3 


2 




1 17.0-17.9 


6 


0 


0 


1 


II 


7 


1 


0 


4 




1 16.0-16.9 


5 


3 


2 


0 


II 


6 


8 


7 


3 




1 15.0-15.9 


4 


2 


4 


3 


II 


5 


5 


8 


10 




1 14.0-14.9 


3 


1 


1 


0 


II 


6 


14 


9 


6 




1 13.0-13.9 


3 


7 


2 


0 


II 


12 


16 


12 


6 




1 12.0-12.9 


5 


4 


5 


1 


II 


17 


18 


15 


8 




1 11.0-11.9 


5 


5 


3 


2 


II 


9 


12 


11 


12 




1 10.0-10.9 


2 


6 


6 


2 


II 


5 


10 


11 


12 




1 9.0-9. 9 




5 


5 


3 


II 


4 


7 


10 


12 




1 8. 0-8. 9 




3 


2 


6 


II 




3 


3 


12 




1 7.0-7. 9 






4 


4 


II 




0 


5 


9 




1 6.0-down 






1 


1 


II 
1 1 




1 


1 


2 




1 Total 


40 


40 


40 


40 


II 


80 


100 


100 


120 




1 Mean 


15.3 


12. 


4 11.3 


8.7 


II 


14.1 


12.8 


12.4 


10.5 




1 S.D. 


3.0 


3. 


2 3.6 


3.5 


II 


2.9 


2.7 


3.0 


3.5 




1 ^bis 










“1 1“ 
II 
II 












1 .90-. 99 


7 


4 


5 


17 


1 1 
II 


7 


5 


5 


22 




1 .80-. 89 


6 


1 


1 


1 


II 


5 


0 


0 


2 




1 .70-. 79 


8 


5 


4 


4 


II 


11 


3 


7 


7 




1 .60-. 69 


7 


13 


4 


7 


II 


14 


19 


11 


17 




1 .50-. 59 


2 


8 


9 


3 


II 


12 


30 


22 


19 




1 .40-. 49 


8 


7 


7 


1 


II 


17 


20 


15 


17 




1 .30-. 39 


1 


0 


3 


0 


II 


7 


9 


16 


12 




1 .20-. 29 


0 


0 


2 


4 


II 


4 


3 


6 


6 




1 .10-. 19 


0 


2 


5 


1 


II 


2 


5 


10 


7 




1 .00-. 09 


0 


0 


0 


1 


II 


1 


3 


0 


6 




1 Negative 


1 


0 


0 


1 


II 




3 


8 


5 




1 Total 


40 


40 


40 


40 


II 


80 


100 


100 


120 




1 Mean 


.63 


.57 


.48 


.52 


II 


.55 


.46 


.40 


.43 




1 S.D. 


.20 


.14 


.19 


.26 


II 


.18 


.19 


.24 


.23 
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TEACHER QUESTIONNAIRE 



ERIC 



1. Please indicate what grade this class is in. Grade: 1 2 3 4 

2. Please give the number of children in the class. Number: 



3. Please indicate how many years you have been teaching. (Please check one) 

This is my first year 

More than 1 but less than 6 

At least 6 but less than 10 

10 years or more 

4. Axe you familiar with TV program AL MANAAHIL? Yes No 

5. How many half-hour programs of AL MANAAHIL have you seen? (Please check one) 

I haven’t seen any 

Pve seen 1 or 2 

Pve seen more than 2 but less than 10 

Pve seen 10 or more 



6. How do you feel about the TV series AL MANAAHILl (Please check one) 

I like it very much 

I like it 

Pm not sure 

I dislike it 

I dislike it very much 

7. Please give your opinion of the overall effect of AL MANAlAHIL on children. 

(Please check one) 

Very Positive 

Positive 

Not Sure 

Negative 

Very negative 



8. Please give your opinion of the effect of AL MANAAHIL on the reading skills of your 
students. (Please check one) 

Very Positive 

Positivee 

Have no opinion 

Negative 

Very Negative 



9. Please give your opinion of the effect of AL MANAAHIL on the children’s understandmg 
and appreciation of Arabic culture and tradition. (Please check one) 

Very Positive 

Positive 

Not sure 

Negative 

Very Negative 



Please indicate what kind of feedback you have had from parents about AL MANAAHIL. 
(Please check one) 

Very Positive 

Positive 

Have had no feedback 

Negative 

Very negative? 1 1 O 

X X ^ (Please turn page over) 
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12. How do you think the children feel about AL MANAAHIL'i (Please check one) 

They like it very much. 

They like it somewhat. 

They neither like it nor dislike it. 

They dislike it. 

They dislike it very much. 

13. Please indicate what effect AL MANAAHIL has had on your teaching? (Please check one) 

Very positive 

Positive 

Neither positive nor negative 

Negative 

Very negative 

14. Please give one or two examples of ways AL MANAAHIL has been helpful to you. 



15. Please give your opinions of the strengths and weaknesses of the AL MANAAHIL 
TV series. 

STRENGTHS: 



WEAKNESSES: 
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THANK YOU FOR YOUR ASSISTANCE IN THIS STUDY. 
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AL MANAAHIL QUESTIONNAIRE 



1, Please indicate which of the following are true for you. (Check all that apply) 

Parent 

Primary School Teacher 

Secondary/College Instructor 

Graduate Student 

Undergraduate Student 

Reading Instructor 

Other (_ _) 

2, Do you have any young children - ages 5 to 9? Yes No 

3, Are you familiar with the TV program AL MANAAHIL? Yes No 

4, Do you watch AL MANAAHIL with your children? Yes No 

5, How many half-hour programs of AL MANAAHIL have you seen? (Please check one) 

I haven’t seen any 

I’ve seen 1 or 2 

I’ve seen more than 2 but less than 10 

I’ve seen 10 or more 

6, How do you feel about the TV series AL MANAAHIL? (Please check one) 

I like it very much 

I like it 

I’m not sure 

I dislike it 

I dislike it very much 

7, Please give your opinion of the overall effect of AL MANAAHIL on children. 

(Please check one) 

Very Positive 

Positive 

Not Sure 

Negative 

Very negative 



8. Please give your opinion of the effect oi AL MANAAHIL on the reading skills of 
children in Jordan. (Please check one) 

Very Positive 

Positive 

Not Sure 

Negative 

Very negative 

9. Please give your opinion of the effect of AL MANAAHIL on the children’s understanding 
and appreciation of Arabic culture and tradition. (Please check one) 

Very Positive 

Positive 

Not Sure 

Negative 

Very negative (Please turn page over) 
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10. What kinds of opinions have you heard from your associates about AL MANAAHIL? 

(Please check one) 

Very Positive 

Positive 

Not Sure 

Negative 

Very negative 

11. How do you think children feel about AL MANAAHIL? (Please check one) 

They like it very much 

They like it somewhat 

They neither like it nor dislike it 

They dislike it 

They dislike it very much 

12. Please comment on what you see as the strengths and weaknesses of the AL MANAAHIL TV 
series. 

STRENGTHS: 



WEAKNESSES: 



THANK YOU FOR YOUR ASSISTANCE IN THIS STUDY. 
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A. Re port from Country 1 

The Arabic Reading Skills test was administered from January 20 
through February 15, 1987, following the guidelines given to me by Dr. 
Richard Murphy, the project's Testing Director, during the visit he 
made in late December 1986 . The testing was carried out following an 
official authorization issued by the Ministry of Education on January 
20, 1987. As was originally agreed upon, the testing was done in two 
schools. The selection of these schools was made after a series of 
interviews with school principals. The major selection criterion that 
was applied was the extent to which the schools were representative of 
the general school population. 

School #01 was composed of children of employed parents with less 
than average income. There was about an average success rate in 
primary school ceritificate (by reference to the national average) . 

The class size for School #01 was from 21 to 37. 

School #02 was composed of children whose parents were generally 
literate with average income. They achieved about 15 points above the 
average success rate in primary school certificate. The class size of 
School #02 was from 25 to 34. 

The training was administered by a Professor of educationlal 
psychology at the University, a member of the project's advisory 
committee, to the testers (all highly qualified Arabic teachers). The 
testing was carried out by the same team in both schools. The school 
teachers were not involved in the testing. Their role was limited to 
helping with discipline. 

In order to ensure maximum reliability, all the testing took 
place in the mornings in the Arabic classes. 
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Some general observations about the test follow: 

1. The test was difficult for first graders (compared with the 
others) . 

2. In School #01 the children had more difficulty with the test 
than the corresponding children in School #02. 

3. The testers found it necessary to resort to Arabic language 
of the country to clarify the instructions (instructions 
only, of course). 

4. The lack of vowel diacritics contributed to the difficulty of 
the items, especially for first and second graders. 

5. Some letters and numbers were still unknown to the first 
graders in both schools. They had not been covered yet. 

6. There were children who were repeaters (repeating the grade 
level) . 

7. It was difficult for most children to report their exact 
birth dates. In spite of our serious attempts, we could not 
get the exact dates for all the testers. 

8. Some of the children tested were taken by their teachers to 
have learning difficulties. These children did not have any 
special treatment in the school or during the test. 

9. Some of the questions were left unanswered because they were 
not understood or because of the time constraints. 

10. The 2 first grades that were tested in School #01 were not 
found to be of equal standards. 
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In spite of the above difficulties, the test was judged to be an 
interesting and enjoyable experience for the children and their 
teachers. Both expressed the wish of having access to more similar 
materials. No major incidents or deviations were recorded, and it can 
safely be said that the testing took place in the BEST conditions 
possible. 
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B. Report from Country 2 

After a delay of about five weeks due to the late arrival of the 
three parcels sent by Dr. Richard Murphy and after their retrieval 
from Customs by the end of the second week of January, another week 
was spent in presenting the whole project to the primary school 
authorities for final acceptance. Actual testing took place between 
January 19 and 31, 1987. It was totally monitored in two schools by 
assistants of one of the advisory committee members. 

1. A governmental primary school where we tested all the five 
second year classes and two third and two fourth year classes 
with no problems. We tried to test a first year class and 
then we realized that they had only seen 7 letters in class 
and that that situation is general in the whole country. We 
managed to go through some of the first parts of the test but 
I do not think that one should or could use the results 
objectively. The children were almost as a group incapable 
of any actual reading. 

2. A private primary school (partly run by the White Sisters) 
which caters to a more favored part of the population of the 
country. This choice was necessitated by our first year 
results in School #01 which can be definitely considered to 
represent the average primary school in a "poor” urban 
situation. This situation is, to my point of vie* , the norm 
for this country. We tested all three second year classes in 
that school and tried another first year without great 
success realizing from the beginning of that last day of 
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testing that all first year school children in the country 
are incapable until the end of their school year to 
accomplish much by way of reading. 

A total of 469 school children were tested, out of which 266 were 
in the second year of testing. School #01 tested 319 school children, 
and School #02 tested 150. 

Some observations follow: 

1. Five students have incomplete identification and we could not 
get their whole birthdate. 

2. As far as the te itself is concerned, I have the following 
remarks : 

a) The problem of Indian numerals (not those used to number 
the test items which were all re -numbered) made Item 66 
impossible for most first and second graders. Those who 
scored correct answers must have used their intelligence 
relating the question to Item 68 on the same page. 

b) Items 67 and 150 relate to the order of the letters in 
the alphabet and that order is never told in our system 
of education. I myself would have been unable to answer 
both questions. 

c) In Item 72 the school children were given the four Arabic 
numerals either orally or in writing (on the boards). 

d) Items 50, 54, and 64 (answer 3) are very ambiguous 
visually and most children did not know what to do with 
them. The oriental ♦’headgear^’ in 54 was not at all 
understood. 
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e) Item 65 shows that proposed answer 1 (the grazing cow) 
was frequently seen as the answer because of the 
association ”non-smoking" •forest area. 

f) Items 84 and 85 relating to the "sun" and "moon" letters 
were not understood at all because that specific 
terminology is not used in our primary school system of 
education. It is later used in the secondary. 

g) In Items 86 and 87 the meaning of the question is not 
easy to understand even for adults. 

h) Items 107 and 108 are cases of "Yes, we want no bananas”. 

i) Items 41 and 106 are good examples of lexical 
differentiation between Machrak and Maghreb. 

There is only one remark now at the level of coding. Every empty 
space in the form indicates that the question was either not answered 
at all or that there was more than one answer. 
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Al Manaahil Advisors 



Dr« Muhammad Ibrahim 
Dn Fakhri Tomalia 

Dr. Farid Abu-Zeina 

Mrs. Zeinab Yassin 
Dr. Yehia EFEzzabi 

Mr. Galal EI-Rashidi 

Dr. Abdelkader Ezzaki 

Dr. Mohamed Ma’mouri 
Dr. Riyad EI-Marzouki 



Chief Academic Advisor — AL MANAAHIL 
Director of Language Center 
University of Jordan 

Dean of Students and 
Instructor of Arabic Methodology 
UNRWA 

Amman Training Center 
Director 

Educational Research and 
Development Center 
Yarmouk University 

Undersecretary for Educational Programs, 
Ministr} of Information 

Professor and Vice Dean of 
Academic Affairs 
The American University of 
Cairo 

Undersecretary and Advisor to 
Ministry of Information and 
Director of Information, 

Education and Communication 
Center 

Associate Professor 

Faculty of Educational Sciences 

University of Mohamed V 

Professor of Linguistics 

and Director, Bourguiba Institute 

Professor of Faculty of Arts, 

Universit)' of Tunisia and 
Director of National Radio Tunisia 



Dr. Abdo Rabo Garada 
Dr. Mohamed Al-Shahari 

Dr. Abdel Rehman Kadok 



Undersecretary 
Ministry of Education 

Director of 

Educational Research and 
Development Center 

Advisor of Educational 
Research and Development 
Center 



Jordanian Ministry of Education: 
Dr. Ahmed Hiassat 
Dr. Ibrahim Musalam 
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